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The report examines three major research thrusts of 
the Early Intervention Research Institute at Utah State University. 
First, meta analysis, a procedure used to review and integrate 
results of 156 studies (1937-1983) on the efficacy of early 
intervention with handicapped, at-risk, or disadvantaged children, is 
evaluated and its needs established. Among tentative conclusions 
offered as a result of the review are that intervention programs do 
result in moderately large immediate benefits for handicapped and 
disadvantaged populations; the more highly structured programs are 
directly associated with more effective outcomes; certified primary 
intervenors are substantially more effective than noncertified 
into enors; and that for disadvantaged populations, the immediate 
benefits of early intervention decline rapidly up to about 36 months 
after the intervention is completed. Results were not clear-cut as to 
whether or not involving parents in intervention programs is 
effective. The second major research effort was directed to analysis 
of cost effectiveness for half day versus full day programs for 
communicatively and mentally disabled children. An economic model for 
cost analysis is proposed and its use illustrated. The third research 
activity described is a longitudinal study of early intervention with 
hearing impaired students. Among findings was that hearing impaired 
Ss who received early home intervention perfomed better than late 
intervention Ss on communication/language skills in relationship to 
academic skills. Additional chapters describe disseminative 
activities, the functions of the advisory committee, research 
training for graduate/research assistants, and project management. 
(CL) 
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CHAPTER I 
INTRODUCTION 

The Early Intervention Research Institute (EIRI) at Utah State 

University was funded on October 1, 1982 by the U.S. Department of Education 

to undertake a five-year program of research in the area of the efficacy and 

cost effectiveness of early intervention for handicapped preschool children. 

As outlined in RFP 82-040, the research program had a specific purpose: 

The purpose of this research program is to investigate the effec- 
tiveness and associated costs of early education and related 
services for infants and children with different kinds and 
severities of handicapping conditions. Research should also * 
address the optimal duration and intensity of educational services 
for children and families having significantly different 
characteristics. A research program in this priority area should 
include the collection of original (new) research data and the 
analysis of research data already reported in the professional 
literature. Further, new data collection should be aimed at 
handicapped populations for which few or no cost or efficacy data 
are available. 

In their proposal, staff at the Exceptional Child Center noted the 
massive resources being devoted to conducting early intervention programs 
and to conducting research about the efficacy of those programs. 
Unfortunately, the evidence for effectiveness was equivocal and an effective 
integration of existing knowledge was needed. In addition, two main 
problems in determining the costs of early intervention were noted: first, 
the failure to consider all sources of costs of intervention programs, and 
second, the failure to consider effects in relation to costs. • * 

To address the problems resulting from failures to integrate the 
results of previous research,, an integrative review of the early 
intervention research literature was proposed to serve as a basis for 
designing needed c-fficacy studies. 



The techniques proposed to conduct this review were first developed by 
Sene Glass (1976) and are referred to as "meta-analysis". Briefly 
described, conducting a meta-analysis requires the location of either all 
studies or a representative sample of studies on a given topic, converting 
the results or outcomes of the studies to a common metric, coding the 
various characteristics of studies that might have affected the results, and 
then using correlational and descriptive statistical techniques (both 
univariate and multivariate) to summarize study outcomes in a way that 
allows the examination of covariation of study characteristics with 
outcomes. Since its introduction, the meta-analysis approach has been used 
to review and integrate research findings on a wide variety of topics 
including the relationship of class size to achievement (Glass & Smith, 
1979), the relation of socioeconomic status and academic achievement (White, 
1982), the efficacy of stimulant drugs for treating hyperactivity (Kavale, 
1980; White & Myette, 1982), the effectiveness of training and reinforcement 
on standardized test results (Taylor & White, 1981), and the effectiveness 
of sensorimotor training with handicapped children (Kavale, 1981). In all, 
over 100 meta-analyses studies have been completed and reported. Although 
not all previous meta-analyses have been well done, it is clear that the 
meta-analysis techniques are being accepted as a useful methodology by 
substantial numbers of professionals. 

The second major focus of the Institute was to conduct research 
concerning the cost effectiveness of early intervention (i.e., how much does 
it cost for a program to result in a specified level of effect?). Two 
requirements for a good cost-effectiveness analysis were identified: (1) 
decision alternatives must exist, and (2) a cost analysis must accompany an 
effectiveness evaluation of each alternative (Levin, 1981). For example, to 
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determine which approach would be the most cost effective method for 
intervening with speech impaired children, a crucial step in the analysis 
would be to specify the feasible alternatives to be evaluated— e.g. , half- 
day versus full-day programs, or supplementing a center-based program with a 
home-based program versus just having the center-based program. It does not 
make sense to attempt to determine a given program is "cost effective". The 
real question concerns whether it is cost effective as compared to some 
feasible alternative. 

Most previous educational research and evaluations had compared only 
the effectiveness of programs and ignored the availability, cost, and use of 
resources. However, because program selection and implementation (duration 
and intensity) are restricted as a direct function of resource allocation, 
program costs should be an element in any analysis of impact. The approach 
to cost effectiveness analysis proposed by the FIRI staff requires an 
examination of all expenses (costs) associated with a program. "Costs" are 
defined as the value of the resource that would be available for alternative 
use if a service was not provided (Conley, 1973; Levin, 1981). Although a 
review of previous research on early intervention programs did locate many 
studies analyzing "effect" data and some analyzing "cost" data, no true 
cost-effectiveness studies were identified. Most studies which have used 
the terms "cost benefit" or "cost effectiveness" have simply computed per 
child costs and/or have failed to do an extensive analysis of either costs 
or effects (Bedger, 1974; Frakes, 1981; Frohreich, 1973; Kakalik et al., 
1981). 

The controversy surrounding the "best" mode for early intervention has 
increased over the years. The increoised use of different methods of service 
delivery stimulated much of this debate. Unfortunately, questions about the 
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"costs" and "benefits" to parents and society of different forms of inter- 
vention have been largely unanswered. The development of cost-effectiveness 
analysis procedures to be used by the Early Intervention Research Institute 
builds upon cost-effectiveness analysis methods proposed by Levin (1975, 
1981): 

To carry out its basic mission, the Utah State University Early 
Intervention Research Institute established the following goals: 

1. Integrate the findings and conclusions from previously conduc- 
ted research on early intervention to determine what is known, 
what gaps exist, and where future research should focus. 
Update this review annually and integrate the findings from 
this update with the Institute's own ongoing work. 

2. Conduct an integrated program of early intervention research 
(including longitudinal research) focused on the most impor- 
tant problems and issues encountered in delivering early in- 
tervention in typical service settings. 

3. Disseminate information about the Institute's findings and 
products to a broad audience of professionals and families 
concerned with early intervention for the handicapped. 

4. Train graduate students and research assistants in research 
techniques and effective methods of intervention applicable to 
preschool handicapped populations. 

5. Formally evaluate the impact of the Institute's findings and 
products in the field of early intervention. 

6. Solicit input, criticism and feedback from a broad constituen- 
cy (Advisory Committee members and others) to ensure that the 
Institute's direction and procedures are appropriately focused 
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and being carried out in such a way as to result in the broad- 
est possible impact of institute findings and accomplish- 
ments. 

During the first year of the Institute, the goals listed above were 
addressed through a series of three related research thrusts and a variety 
of other activities. 

The first project utilized the techniques of meta-analysis as a tool to 
integrate the hundreds of completed research reports which have 
investigated early intervention with handicapped children. This 
comprehensive integration of existing research was designed to help the 
Institute staff determine what conclusions can be drawn from existing 
research, what gaps exist, and how conclusions about eff ectiveness varied 
between various subgroups of children or families (e.g., severity of 
handicapping condition, type of handicap, level 'of SES). 

The second research project developed state-of-the-art techniques for 
analyzing the cost effectiveness of programs and applied those procedures to 
a cost-effectiveness analysis of half-day versus full-day programs. One of 
the most important outcomes of this research thrust was the development of 
procedures and "ingredients" for doing cost-effectiveness analyses of early 
intervention programs for the handicapped. In subsequent years of EIRI, the 
basic procedures developed during Year #1 will bo applied to other questions 
and issues identified from the meta-analysis or through interaction with the 
field. Thus, the two major research thrusts for Year #1 served a "start up" 
function as described in the-RFP, while at the same time resulting in 
important information which can effect practice and influence policy. 

The third research thrust for Year #1 took advantage of a unique data 
base to examine a question about the effectiveness of early intervention for 
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which it appears that very few data exist— the long-term impact of early 
intervention with hearing impaired children. Four groups of hearing 
impaired children (each group with 25 children) born between 1973 and 1975 
were compared on a variety of dependent variables. One of these groups 
received home-based early intervention through Project SKI*HI (a nationally 
dissemi-nated early intervention project for hearing impaired children based 
at Utah State University) before 30 months of age, a second group received 
home-based intervention from Project SKI*HI after 30 months of age, a third 
group received center-based intervention, and a fourth group did not receive 
any early intervention. 

Other major activities undertaken by the Early Intervention Research 
Institute during its first year included: (1) disseminating information 
about research findings, (2) naming and utilizing an advisory council to 
provide feedback on Institute efforts, (3) training of graduate students, 
and (4) establishing a management system for project activities. 

A detailed description of the results from the three major research 
thrusts and the other major activities undertaken by the Institute appears 
in the sections to follow. 
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CHAPTER II 

META-ANALYSIS OF EARLY INTERVENTION RESEARCH 

Evaluation (i.e., efforts to determine the worth or value) of early 
intervention programs have taken many different forms— both large and small. 
For example, in 1975 a third party evaluation contract was awarded to 
Battelle Institute of Columbus, Ohio, to evaluate the impact of early 
intervention demonstration programs funded by the Handicapped Children's 
Early Education Program of the 11. S. Department of Education. One hundred 
twenty-nine randomly selected children in 29 projects from all over the U.S., 
were tested in areas including social, motor, cognitive, and communicative 
skills. Based on these data, the evaluators concluded that across all 
categories of handicapping conditions, children made one-and-a-half to two 
times greater gains than they would have been expected to make without the 
benefit of the project. Additionally, 97% of those parents interviewed 
perceived positive changes or improvements which they attributed to the 
project (Stock, Wnek, Newborg, Schenck, Gabel , Spurgen, & Ray, 1976). 
DeWeerd (1981) concluded that another indicator of the worth of HCEEP-funded 
demonstration projects was the fact that in 1979, 85% of the initial 
demonstration projects had secured funds to continue their programs ano' that 
the level of funding had increased. Literally hundreds of other research 
studies for both HCEEP-funded and other early intervention programs have 
collected data to determine the "worth 1 * of such programs. 

Unfortunately, the results and conclusions from such evaluations have 
been disturbingly discrepant.- For example, there is growing agreement among 
practitioners that early intervention promises significant resolution or 
amelioration to some of the most persistent and expensive problems which 
educators face. According to Jordan, Hayden, Karnes, and Wood (1977): 
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Programs providing early educational and therapeutic 
programming to meet the needs of young handicapped 
children and their families are reducing the number of 
children who will need intensive or long-term help. The 
importance of reaching handicapped children early and 
working to help them reach their full potential cannot be 
overemphasized. With early help, the sooner the better, 
these children can often function at higher levels than 
has been dreamed possible in prior years, (p. 26) 

However, the promise and benefits of early intervention have not been 

universally accepted. As Hodges and Sheenan (1978) pointed out, "no 

consistent picture of success emerged from the early childhood education 

efforts of the 1960s. Although modest or robust immediate gains from 

structured programs were frequent, just as frequently, these gains eroded 

after the children left the experimental programs" (p. 4). Gottfried (1973) 

concluded that: 

Gains in cognitive and intellectual functioning 
attributable to preschool training were found by some 
projects but not others at the time of school entrance. 
However, there were no reports of substantial persistent 
gains beyond the third grade. Those studies which 
conducted school -age follow-up studies uniformly reported 
disappointing long-term results, (p. 286) 

Even though the results of research should guide policy and practice, 
research on early intervention, when considered as a total body of evidence, 
has been confusing. Some researchers have reported success; others, failure. 
Some have suggested that early intervention is effective but only for 
specific subgroups of children. Thus, even though the concept of early 
intervention has been heartily endorsed by individual practitioners and state 
and federal funding agencies (Swan, 1980), the research evidence is not at 
all clear. Even more important, the factors which account for the variation 
in research results have not been identified. 

As primary research articles investigating the effectiveness of early 
intervention have accumulated, practitioners and policymakers have 
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Increasingly called for an effective integration of the knowledge which is 
being produced. In theory, the results of both basic and applied research on 
a given topic, such as early intervention, should culminate in increased 
knowledge and improved practice. In reality, however, the very important 
step of integrating the findings of the completed research on the effective- 
ness of early intervention into conclusions which affect practice and 
influence policy has not occurred. 

Problems with Typical Efforts to Integrate Research Findings 

In recent years, more and more researchers have realized that commonly 

used techniques for summarizing the results of completed research were 

inadequate (Glass, 1976; Jackson, 1980; Light & Smith, 1971). As Glass 

(1976) pointed out: 

We need more scholarly effort concentrated on the problem 
of finding the knowledge that lies untapped in completed 
research studies. We are too heavily invested in 
pedestrian reviewing where verbal synopses of studies are 
strung out in dizzying lists. The best minds are needed 
to integrate the staggering number of individual studies. 
This endeavor deserves higher priority now than adding a 
new experiment or survey to the pile. (p. 4) 

The typical approach among social scientists to reviewing and 

integrating the* literature on a given topic follows one of two routes. In 

both approaches, a group of easily accessible articles from fairly prominent 

journals or other publications are listed. In the first approach, the 

reviewer offers a verbal synopsis of the 20 to 40 research articles and 

often concludes that the existing research is inconclusive: sometimes 

researchers find one thing; sometimes, another. A call is then made for 

additional research using better techniques and more precise methodology so 

that the truth of the matter can be discovered. In the second approach, the 

reviewer begins with a similar group of articles, but eliminates all but a 

\ .13 
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few because of supposed design or analysis flaws. The findings of the 
remaining "acceptable" studies (frequently studies which agree with the work 
of the reviewer or his/her colleagues) are presented as the truth of the 
matter. 

Both approaches to integrating and understanding previously completed 
research in the social sciences have serious inadequacies. Almost always, 
the articles selected for the review are only a small, nonrepresentative 
fraction of the total research on the particular topic, and thus ignore a 
significant body of information. In addition, the "definitive" study almost 
never exists. Obv.iously, better design and analysis procedures are 
desirable, but it 1s not at all unusual for a series of well designed studies 
on the same topic 1n the social sciences to yield conflicting results. 

Meta-Analvsis Procedures 

The problems which have been experienced with trying to integrate the 
existing literature on the effectiveness of early intervention are pervasive, 
but they are not intractable. Over the last decade, substantial effort has 
been devoted to improving techniques for integrating the results of previous 
research (Glass, McGaw, & Smith, 1981; Light & Pillemer, 1982; Hunter, 
Schmidt, & Jackson, 198.1; Rosenthal, 1978). Out of these efforts has evolved 
a set of procedures known as meta-analysis which have much potential for 
effectively summarizing the results of previous research. 

Briefly described, conducting a meta-analysis requires the location of 
either all studies or a representative sample of studies on a given topic, 
converting the results or outcomes of the studies to a common metric, coding 
the various characteristics of studies that might have affected the results, 
and then using correlational and descriptive statistical techniques (both 
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univariate and multivariate) to summarize study outcomes in a way that allows 
the examination of covariation of study characteristics with outcomes. In 
his critique of previous efforts to integrate the findings of research in the 
social sciences, Jackson (1980) concluded that the "meta-analysis approach is 
a very important contribution to the social science methodology. It is not a 
panacea, but it will often prove to bi quite valuable when applied and 
interpreted with care" (p. 455). 

Since its introduction, the meta-analysis approach has been used to 
review and integrate research findings on a wide variety of topics including 
the relationship of class size to achievement (blass & Smith, 1979), the 
relation of socioeconomic status and academic achievement (White, 1982), the 
efficacy of stimulant drugs for treating hyperactivity (Kavale, 1980; White & 
Myette, 1982), the effectiveness of training and reinforcement on 
standardized test results (Taylor & White, 1981), and the effectiveness of 
sensorimotor training with handicapped children (Kavale, 1982). In all, over 
100 meta-analysis studies have been completed and reported. Although not all 
previous meta-analyses have been well done, it is clear that the meta- 
analysis techniques are being accepted as a useful methodology by substantial 
numbers of professionals. 

It should be noted that some educational researchers have raised 
questions about the use and interpretations of meta-analysis (Mansfield & 
Bussee, 1977; Eysenck, 1978; Gallo, 1978; Shaver, 1979; ERS, 1980; Simpson, 
1980). Some have questioned the results of a specific meta-analysis; others 
have raised cautions or concerns about the methodology per se. Most of these 
criticisms and cautions have been responded to in the literature (Glass, 
1978, 19(0; Glass & Smith, 1978; Glass et al., 1981). The most important 
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point that such concerns have demonstrated is that meta-analysis, like 
all other research procedures, 1s not a fall-safe approach. However, the 
meta-analysis methodology, 1f properly Implemented, has excellent potential 
as a tool for Integrating existing research. 

Purpose and Objectives 

The purpose of this study was to apply meta-analysis techniques to as 
many research studies on the efficacy of early Intervention as could be 
Identified. All primary research studies were Included In the meta-analysis 
which: (a) reported research on the efficacy of an Intervention program 
designed to improve the cognitive, social/emotional, or life skills of 
handicapped, at-risk, or disadvantaged children, (b) began before children 
were 66 months old, and (c) were designed and reported so that an estimate of 
program impact could be calculated. Such estimates of Impact were included 
from experimental, quasi-experimental, and pre/post designs. 

The specific objectives of the study included: 

1. To determine what past research reveals about the effectiveness of 
early intervention, including what factors and study characteristics 
(e.g., age of child, type of intervention, nature of the dependent 

i 

variables, involvement of the family) covary with and possibly 
influence study outcomes. 

2. To prioritize and focus future research efforts by identifying those 
research questions which need further Investigation and replication 
as opposed to those questions which have already been sufficiently 
investigated, documented, and replicated. 
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The remainder of this report will briefly examine the adequacy of 
previous reviews of the early Intervention literature to establish a 
foundation for the work described 'herein , describe the procedures used 1n the 
meta-analysis, and report the results of the first 156 studies Included 1n 
the analysis. Findings 1n this report should be viewed as tentative since 
additional studies are now being coded for future Inclusion. Appendix 2-A 
Includes a listing o* the primary references of each of the studies thus far 
included, and a listing of studies which have been Identified and obtained 
but will be included later. 

Analysis of Previous Reviews of Early Intervention Research 

As 1n any systematic process of scientific Inquiry, it was important, 
before beginning the meta-analysis of early Intervention research, to examine 
previous efforts to accomplish the same goals. Such a "review of the litera- 
ture" (in this case, an analysis of previous efforts to integrate early 
intervention research) served two main purposes. First, an analysis of prev- 
ious reviews was necessary to determine whether there was a need for another 
review of the literature (e.g., was previous work methodologically sound; did 
sufficient evidence, I.e., primary research studies, exist to answer the 
auestions of interest; was there substantial evidence which had not been 
included in previous reviews?). Secondly, an examination of previous work is 
important to plan for future work by establishing an appropriate point of 
departure and identifying the strengths: and weaknesses of past investigations 
so that the former can be built upon and the latter avoided. 

Previous Reviews Included in* Analysis 

A computer-assisted search of ERIC, Psychological Abstracts , CEC 
Abstracts , Dissertation Abstracts , Social Science Research , SSIE Current 

« 

..y 

17 



15 

Research, and Index Medlcus was conducted to Identify previous reviews of the 
literature which dealt with (a) preschool or young children, (b) some form of 
intervention or treatment, and (c)' handicapped, disadvantaged, or at-risk 
populations. Sixty-four review articles were Identified by this search (see 
Appendix 2-B for a list of references of those articles). A coding sheet was 
used to collect Information about each review. on the following questions: 

1. Does the reviewer critique previous reviews and explain how his/her 
review will differ from, expand, or replicate previous work? 

2. Does the reviewer describe the procedures used to locate or delimit 
primary research studies used in the review? 

3. What 1s the actual number of efficacy of early Intervention studies 
used 1n the review to draw conclusions? 

4. How did the author represent the results or findings of Individual 
efficacy studies? 

5. How did the reviewer consider data about how concomitant variables 
might covary with outcomes? 

6. What variables were suggested by the reviewer as variables which 
might affect the effectiveness of early intervention (e.g., low vs. 
high SES subjects; or age at which intervention begins)? 

7. What were the conclusions of the authors about common methodological 
weaknesses in the primary research included in the review? 

8. What were the major conclusions of the review? 

The 64 review articles included in the analysis were published between 
1966 and 1982 in a variety of educational, psychological, and medical 
journals, as well as government reports, ERIC documents, and textbooks. The 
64 reviews cited a total of 630 primary research studies 1 to draw conclusions 
about the efficacy of early intervention. Surprisingly, there was very 



Although 630 efficacy of-early Intervention "studies" were counted, 
these studies were reported in 1,027 unique articles. Often, there were 
multiple articles written about the same study. Primary research articles 
written by the same authors were considered to be from the same study unless 
there was contrary evidence. 
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little overlap in the primary research studies cited from review to review as 
shown in Table 2.1. For example, 466 studies were cited in only one review 
and only one study was cited in as many as 24 of the 64 reviews. 

Table 2.1 

Frequency with Which Primary Research Studies on Efficacy 
of Early Intervention Were Cited by 64 Reviewers 



Number of Reviewers Who Cited 


Number of Studies 


1 


466 


2 


84 


3 


22 


4 


26 


5 


14 


6-7 


6 


8-13 


8 


14-18 


3 


24 


1 



Total number of primary studies cited by reviews 630 



The particular research studies which were cited most frequently in these 64 
reviews are shown in Table 2.2. The primary focus of most reviews was on 
disadvantaged populations; and 18 of the reviews did not consider handicap 
populations. The number of early intervention efficacy studies cited in each 
of the reviews ranged from 9 to 74, with a median of 16.5. 

Is There A Need for Another Review of the 
Early Intervention Research Literature? 

One of the most obvious evidences of need for another review of the 

early intervention research literature was the fact that although hundreds of 

early intervention efficacy studies were identified in this analysis, the 

average number of studies cited in existing reviews was only 16.5. Although 
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Table 2.2 

Primary Research Studies Most Frequently Cited by Reviewers 
of Early Intervention* Research Literature 



Research study and/or principal 
author(s) 



No. of 
reviewers 



Representative 
references 



1) 


Weikart/Perry Preschool Project 


24 


Welkart (1967, 1968) 
Weikart et al. (1978) 


2) 


Karnes 


18 


Karnes et al. (1969) 
Karnes et al. (1970) 


3) 


Gray & Klaus/Early Training Project 


17 


Gray & Klaus (1965) 
Gray & Klaus (1970) 


4) 


Skeels & Skodak 


17 


Skeels (1965) 

Skodak & Skeels (1949) 


5) 


Heber & Garber/Mi lwaukee Project 


13 


Heber & Garber (1975) 


6) 


Bereiter & Engelman/Direct Instruction 


13 


Bereiter & Engelman 
(1966) 


7) 


Kirk 


10 


Kirk (1973) ' 


8) 


Gordon/Florida Parent Project 


9 


Gordon (1968) 


9) 


Caldwell 


9 


Caldwell .(1967) ' 
Caldwell (1974)" 


10) 


Ramey/Abecedarian Project 


- 8 


Ramey (1974) 

Ramey & Campbell (1979) 


11) 


Levenstein/Verbal Interaction Project 


8 


Levenstein (1976) 


12) 


Hodges 


8 


Hodges & Spicker (1967) 
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some of the later efficacy studies would not have been available for earlier 
reviews, the correlation between year of publication for each of the reviews 
and number of efficacy studies cited was -.10. Thus, the failure to cite 
more efficacy studies does not appear to be a function of the number of 
articles available. The small number of efficacy studies cited, along with 
the failure to specify the criteria for inclusion/exclusion in most previous 
reviews, raises serious questions not only about the general izabi 1 i ty of 
conclusions but about the objectivity of the reviews. With hundreds of 
articles available on the efficacy of early intervention, one couid probably 
find a dozen articles to support any point of view. Tne fact that so few 
studies are cited in most reviews is disturbing. 

Another major problem with previous reviews is the way 1n which results 
of primary research studies are reported. Seventy-eight percent of the 1,500 
citations of efficacy studies in the 64 reviews reported only that 
"differences" were found between experimental and control groups, or that the 
study demonstrated that the intervention was "effective" or "ineffective". 
The problems with such reporting are evidenced by the following typical 
statement taken from Stone (1975, p. 17): "A number of intervention 
techniques have been reported to be of value to the developmental ly delayed 
child. Among these are perceptual training (Frostig & Home, 1964) . . . 
increasing the child's exposure to a variety of stimuli (Koegel, 1970), and 
increasing the discriminative aspects of individual stimulus (Horowitz, 
1968)." When the outcomes of previous studies are reported in this manner, 
it is impossible for the reader to know whether differences between groups 
are educationally significant; statistically significant, or trivial. 
Consequently, it is difficult to know how much confidence to place in the 
conclusions of the reviewer. 
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Another important weakness in existing reviews of early intervention is 
the lack of attention to how subject or study characteristics may covary with 
results. For example, do studies which report interventions with very young 
children as subjects generally find larger benefits than studies which report 
interventions with older preschool children; or do studies with mildly 
handicapped children result in larger differences than studies with 
moderately or severely handicapped children? Seventy-five percent of the 
reviews either failed to consider the covariation of concomitant variables 
with outcomes or based conclusions about such covariation on less than 20% of 
the efficacy studies cited. 

A less serious but nonetheless important weakness with existing reviews 
was their failure to consider previous reviews of the literature. Of the 64 
reviews coded in our analysis, only two cited more than two previous reviews, 
critically described the procedures and conclusions of those reviews, and 
described how their review would differ from or improve on previous work. 
Forty-nine of the 64 reviews failed to cite any previous reviews of the 
literature. The failure to acknowledge and build upon the work of others is 
an important weakness that potentially impairs the quality of future work. 

In summary, there are a number of important methodological weaknesses in 
previous reviews of the early intervention research literature. The number 
of efficacy studies cited in any given review is relatively small and 
probably net representative of the research which has been conducted. 
Techniques for examining the magnitude of outcomes and the covariation of 
subject and study characteristics have been inadequate. Little attention has 
been paid to earlier work which would permit a systematic building on the 
findings of others. Given these weaknesses, the amount of primary research 
which has been conducted to determine the efficacy of early intervention and 
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the millions of dollars which are spent yearly to provide early Intervention 
to handicapped, disadvantaged, and at-risk children underscores the need for 
high quality Integrative reviews of the literature. If properly done, such a 
review would provide important information to policymakers, program 
administrators, researchers, and practitioners about whether and how to 
implement early Intervention programs. 

Planning for Future Work 

Table 2.3 lists the overall conclusions reached by reviewers in the 64 
reviews considered. As shown 1n panel (a), most reviewers concluded that 
early intervention 1s generally effective if properly Implemented. Specific 
benefits attributed to early intervention (see panel b) Included cognitive, 
academic, social, and attitudinal growth for the target child and improved 

» 

functioning of the parents and the siblings. 

Even though most reviewers concluded that there was sufficient evidence 
to document the immediate benefit of early intervention, there was much less 
support for long-term benefits. Of those 23 reviews in which the 
longitudinal effects of early intervention were considered, only 5 (22%) 
concluded that the gains attributable to early intervention programs were 
maintained; 15 (65%) concluded that gains were not maintained; and 3 (13%) 
concluded that there was not sufficient evidence to dra 1 * conclusions. 

Table 2.4 lists the most frequently cited variables which might be 
associated with or influence the success of early intervention. Table 2.5 
shows the conclusions most frequently drawn by reviewers as they relate to 
variables cited in Table 2.4..' Not every variable listed in Table 2.4 is 
represented in Table 2.5 because many reviewers cited a concomitant variable 
as important, but did not draw specific conclusions about that variable. The 

most frequently drawn conclusions 1n the 64 reviews considered were related 

\ <■ 
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Table 2.3 

Conclusions About the Overall Effectiveness 
of Early Intervention 



(a) GENERAL CONCLUSIONS 



# and % of reviews 
drawing conclusion 



47 73.4% o Early intervention is generally effective if 

properly implemented. 
9 14.1% o Early intervention is effective, but only in 

special situations. 
7 10.9% o Evidence about early intervention effectiveness is 

inconclusive. 

1 1.6% o Early intervention is generally not effective. 

(b) SPECIFIC BENEFITS OF EARLY INTERVENTION 

of reviews drawing 
conclusions 

11 o Increases IQ 

9 o Improves academic achievement 

7 o Enhances social skill 

7 o Improves self-concept and emotional health 

6 o Improves parents' behavior and attitudes 

5 o Improves functioning of siblings 

5 o Results in fewer children placed in special 

education programs 

3 o Results in fewer children retained at grade level 

3 o Improves language development 

(c) LONGITUDINAL EFFECTS OF EARLY INTERVENTION 

5 o Gains made in early intervention programs are 

maintained. 

15 • o Gains made in early intervention are not 

maintained. ; 

3 o Evidence about long-term maintenance is 

contradictory and we research is needed. 
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Table 2.4 

Variables Suggested by Previous Reviewers as Potential Mediating Variables 
and the Number of Different Reviews in Which Each Was C1ted a 





INTERVENTION VARIABLES 




SUBJECT VARIABLES 


# of reviews 




# of reviews 


citing 


Variable 


citing 


Variable 


variable 




variable 




23 


Degree of parental Involvement 


21 


Age at which Intervention begins 


14 


Degree of stucture In Intervention 


20 


Socioeconomic status (SES) 


14 


Training/competence/attitude of Intervenor 


17 


Degree of environmental stimulation/ 


12 


Nature of Intervention (e.g., philosophical 




deprivation In home setting 




orientation or type of curriculum) 


14 


Parent/child relationship, and 


11 


Length of Intervention 




whether family Is Intact 


10 - 


Use of operant conditioning principles 


8 


Nutritional level, health care,, or 


9 


Parents' attitude and motivation 




immunization 


9 


Degree to which Instructional level Is 


8 


Severity of handicap 




appropriate for target child 


8 


ftace 


8 


Amount of intervenor/chl Id interaction 


7 


Sex 


8 


Parent modeling of correct behavior aside 


6 


IQ level of child prior to 




from explicit intervention Involvement 




intervention 


7 


Degree of Individualization 


5 


Type of handicap 


6 


Intervenor /chi Id ratio 


5 


Previous preschool experience 


6 


Continuity between preschool and school 








programs 






6 


Site of Intervention (center vs. home) 






5 


Clarity of program goals 






a 0n1y variables which were suggested by five or more 


reviewers are 


Included in this table. 
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Table 2.5 

Conclusions About How Mediating Variables Are Related to, 
or Influence, Intervention Effectiveness 
(Numbers in parentheses indicate the number of reviewers taking that position) 



Medlitlng virlible 


Pro ' 

• 


Con 


Owtt of pirentil Involvement 


Interventions thit Involve parents ire most 
economlcil end most effective (12) 


« 


Age it Intervention 


The eirller the *ge it which Intervention 

htfllnft. £h* AfiAlif th* aiint /111 

n*y inif «nv jrVVvVF Jain* 


Slmllir gilns result from successful 
program* retire less or ige or entry (5) 


Critical 190 


Efforts to Intervene ifter the critical period 
becomes profrtsslvtly less effective (8) 

• 


There Is no Indication of i critical 
period In which eirly Intervention It 
matt tfftetivt fit 


Degret of fttructurt 1n the 
Intervention 

future of Inttrvtntlon 


More structured Intervention program result 
In greater gains (12) 

Curriculum type per se 1s unrelited to 
Intervention effectiveness. However! more 
comprehensive curriculi (Including cognitive; 
bthivloril, md soclil-emotlonil components) 
ire more effective (8) 


Oegret of structure In the Intervention 
Is not relited to Intervention 
effectiveness (1) 


T?A \ rt 1 A A /^Affihlt inrft/lt fc. 4 1 iiHa 

• » n m^/tOmpifcinci/ • 111 wUQf 

of Intervenor 


neiier iriineot more competent intervention* 
Ists result in more effective progrims (4) 




Ltngth of Intervention 
Center vi. home-bised 


Longer progrims result In qrtiter gilns (4) 

Home end center-bised programs. If well 
implemented, irt equilly effective (4) 


Length of Intervention Is unrelited to 
child gilns (4) 

* 

* 


!nd1v1dui)1tition 


Individual Iztd Intervention Is more effective 




Socioeconomic status (SES) 


Low SCS children mike greiter gilns In gross 
motor skills, md high SLS children mike 
greiter gilns in IQ (6) 




Rice 


Rice 1s unrelited to intervention 
effectiveness (1) 


Stick children giln slgnlf Icintly more 
from eirty Intervention thin white 
children (2) 


Severity of h4nd1c4p 


Severity of hindlcip substintlilly Influences 
proqrim success (2) 


Severity of hindlcip is unrelited to 
prugrim success (1) 


Set 


Roys mike greiter gilns then girts on seme 

out COM* * (1) 


Gilns ir* unrelited to $ei of the child 
0) 
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to the involvement of parents, the age at which intervention begins, and the 
degree of structure in the intervention program. As can be seen in Table 
2.5, there was a fair degree of disagreement among reviewers about the 
influence of many of the variables cited. 

This information does much in planning for another review of the early 
intervention research literature. First, these data emphasize that any 
additional efforts to integrate the research on early intervention needs to 
focus on both immediate and long-term benefits, needs to examine outcomes in 
a variety of areas (IQ, academic achievement, social skills, self-concept, 
functioning of parents and other family members, etc.), and needs to examine 
the covariation with study outcomes of a variety of subject (e.g., age at 
which intervention begins, socioeconomic status, race, sex, etc.) and 
intervention (e.g., degree of parental involvement, degree of structure in 
intervention, training of intervenor, etc i -ariables. The results of this 
analysis identify those variables which have been suggested most frequently 
as well as variables which have been cited infrequently but may still be 
important. 

Summary 

The analysis of previous reviews of the early intervention research 
literature definitely established the need for another integrative review. 
Given the large number of existing early intervention efficacy studies, the 
meta-analysis techniques described below seem like a potentially valuable set 
of procedures for making sense of this large data base. The methodological 
weaknesses identified in previous reviews underscores the need for conducting 
another review. The conclusions of previous reviews, both in terms of 
immediate and long-term benefits of early intervention, and the subject and 
study characteristics which are reported to covary with intervention 
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effectiveness, identifies the key information which needs to be collected and 
interpreted in conducting such a review. 

PROCEDURES 

Included in this section is a description of (a) the procedures used 
in selecting and identifying early intervention efficacy studies to be 
included in the meta-analysis, (b) the procedures used in developing the 
coding system and conventions, and (c) the procedures for coding the articles 
included. 

Identifying Studies to Be Used in the Meta-Analysis 

Efforts were made to include any study of the efficacy of early 
intervention with handicapped, at-risk, or disadvantaged children which began 
before 66 months of age and provided information which could be used in 

« 

estimating the benefit of the intervention program. Estimates of benefit 
were derived from pre/post, true experimental, and quasi-experimental 
designs. Single subject research designs have not been included at this 
point because the type of data yielded by such designs is difficult to 
incorporate with more traditional group designs in a meta-analysis data set. 
However, various alternatives are currently being explored that will enable 
us to utilize this valuable data set as the results of the meta-analysis are 
expanded during 1983-84. 

The first step in identifying articles was a computer-assisted 
literature search conducted at the Utah State University Library through the 
DIALOG system. This computerized computer-assisted search was done of the 
ERIC, Psychological Abstracts , CEC Abstracts , Dissertation Abstracts , 'Social 
Science Research , SSIE Current Research , and Index Medicus data bases. 
Very broad guidelines were set deliberately for this search in an effort to 
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include as many studies as possible so that appropriate studies would not be 
missed. An example of the actual, terms used in the computer-assisted search 
for the URIC data base is shown in Table 2.6. Similar sets of descriptors 
were used For each of the other data bases. This search resulted in the 
identification of 1,402 articles which were then sorted by staff members into 
the approximately 800 articles which reported efficacy studies and those 
which reported other information about early intervention. Each article was 
then screened to determine if it reported information on an early 
intervention program which began before 66 months of age for subjects which 
were handicapped, at-risk, or disadvantaged and provided some data from which 
an estimate of the magnitude of program effect could be estimated. Articles 
which passed this initial screening were then put in the "To Be Coded" file. 
Articles which were rejected at this stage were independently checked by 
another staff member to make sure that relevant articles were not excluded. 

It is interesting to note that the computer-assisted search was not a 
very effective means of identifying articles to be included in the meta- 
analysis. Of the almost 1800 articles obtained thus far in the meta-analysis 
effort, only 305 (less than 20%) came from the computer-assisted search. 
Most of the articles that have been identified were obtained through 
references of other articles already in the files. 

In addition to the computer-assisted search and the bibliographic 
searches of articles already obtained, betters were sent to each of the 
HCEEP demonstration and outreach project directors and to all members of the 
EIRI Advisory Committee and field reviewers (copies of letters and the list 
of field reviewers and Advisory Committee members are included in Appendix 
2-C) asking them to identify additional studies of early intervention 
efficacy that may not have been identified in our search. 
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Table 2.6 

Descriptors Used for Computer Assisted 
Search of ERIC for Meta-analysis Articles 
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Once articles were obtained for the meta-analysis, a very specific set 
of procedures was followed 1n preparing them for coding, following them 
through the coding process, and preparing data from the coding for analysis. 
This process 1s depicted 1n Figure 2.1 and 1s described 1n written form In 
Appendix 2-0. 

Development of Coding System and Conventions 

A coding system was developed to collect Information about each article 
included 1n the meta-analysis. Information collected about each study 
included: 

o a description of the subjects included 1n the research, 

o the type of intervention used, 

o the type and quality of research design employed, 

o the type of outcomes measured and procedures used, and 

o the conclusions reached by the study. 
The specific Items included on this coding sheet were identified using the 
analysis of previous reviews so that variables which other authors suggested 
as important were Included. In addition, coding systems used 1n previous 
meta-analyses were examined and useful features incorporated. This first 
draft of the coding sheet was then "pilot tested" by members of the meta- 
analysis team on eight different articles. Several revisions of the coding 
system were done during this process. A copy of the coding system which was 
used to code the studies Included in the meta-analysis is shown in Appendix 
2-E. 

For each item on the coding sheet, conventions were written which 
provided operational definitions for coding. A copy of the meta-analysis 
conventions is Included 1n Appendix 2-F. Because it was impossible to 
specify every eventuality that would be encountered in coding studies, coders 
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Check artlcltt for ipproprlittntti 
ind coalite iUpot ttlon thect 



Second check 
for ipprotrlitcnett 






NOt 


<— 
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Dlttrlbute irtlclot for 
codUf 4ii4 relleblllty 
chocks 



Screen for rtlittd 
irtlclot ind ob* 
tiln it ntcittiry 






nit it 

TO It 


'tlcli(i) In 
COOCO flit 



Codtrt decide 
If irtldo Hi 



Uncodtblc 



Uncodtblc it 1tt 
tnfonwtlon nttdid 



T 



Codtblt, but Mft 
Inftmitlon needed 



ftOftittt Infenutlon end 
updctc dltpotltlon thcct 
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Figure 2.1 Flowchart- of procedures for coding meta-analysis articles. 
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were also instructed to provide "coding clarifications" for Items they coded 
for which the conventions were not a good "fit". These coding convention 
clarifications were discussed with the entire staff each week 1n staff 
meeting and corrections and revisions to codings were made based on that 
Information. 

One of the most Important pieces of Information collected about each 
study was the estimate of program effect. Two types of "Effect Size" were 
collected wherever possible: a standardized mean difference Effect Size and 
a variance Effect. Size. A standardized mean difference Effect Size was 
obtained for every study. The standardized mean difference was defined as 
the (Xe -~Xc) t- SDq (see Glass, 1976). This standardized mean 
difference Effect Size measure converts all scores to a standardized score 
which has similar meaning across different types of variables. For example, 
an Effect Size of 1.0 on a measure of IQ indicates that the average person 1n 
the experimental group 1s 1 standard deviation or 15 points above the average 
person 1n the control group. An Effect Size of 1.0 on a reading test has 
approximately the same meaning, although 1t may be 25 points or 5 points 
depending on the metric of the test being used. For every measure, an Effect 
Size of 1.0 represents 1 standard deviation difference between the average 
score of each group and Indicates that the average person in the experimental 
group would score at the 84th percentile of the control group (assuming 
normal distribution). ; 

Using a standardized metric for outcome avoids problems of interpreta- 
tion due to statistical artifacts which are dependent on sample size and allows 
the covariation of outcome and study/subject characteristics to be examined 
more completely. Unfortunately, means and standard deviations were not 
reported in all studies. In these cases, formula for converting F statistics, 
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Jt statistics , analysis of variance tables, regression equations, and propor- 
tions to Effect Sizes were used (see Glass, McGaw, & Smith, 1981; also 
formula worksheet included in Appendix 2-F). 

Procedures for Coding Studies 

As noted earlier, written procedures for coding each study are included 
in Appendix 2-D. As described in those materials, several procedures were 
used to increase the accuracy and consistency of coding and are worth 
emphasizing here. First, after each article was coded, the coder would take 
the article and the coding sheets to another member of the team and provide a 
very brief synopsis of the type of design used in the study, which outcomes 
were coded, and which information in the article was used to compute the 
effect sizes. The "checker" would then check the logic of which outcomes had 
been selected and independently calculate effect sizes for those outcomes. 
This independent calculation would then be checked against the written 
computations which were done by the original coder. In addition, the checker 
would examine key variables on the coding sheet, check that every blank on 
the coding sheet was filled in, and make sure that the "checklist" on the 
first page of the coding sheet had been properly completed. At that point, 
if mistakes had been found, the issue would be resolved with the original 
coder, and then the coding packet would be turned in. 

In addition to this checking of every article, interrater consistency 
checks were done for 10 articles included in the meta-analysis. The results 
of these interrater consistency checks are shown in Table 2.7. As can be 
seen, the average "exact" agreement (i.e., the most conservative estimate) on 
coding was 86.3 across the 10 studies. Not counting it as a disagreement 
when one coder chose to leave an item blank and another coder chose to make 
an educated estimate of an item, this figure increased slightly to 89%. The 
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Table 2.7 

Summary fflo! Interrater Consistency Checks 



References 



Date 



Exact 



0n<3 
Step 



One 
Step & 
Blanks 



% ES 
In 
Corroon 



Karl filendon Cle David Dennis fiary Marqo Duane 



Brassell, W. R. , Ounst, C. J. Fostering 
the object construct: Large scale Inter* 

mention with handicapped Infants. 

Am erican Journal of Mental Deficiency > 
1973, 32, 507-5107 



2/11/83 



80.4 



82.0 



84.1 



100 



Gavrln, J., S Sacks, L. S. Growth poten- 
tial of oreschool aged chlldrerwtn 
Institutional care: A positive approach 
to a negative condition. American 

_Journa1 of Orthopsychiatry . 1963. 33. 

■99-4o(3. 



2/19/83 



92.3 



92.9 



94.8 



24 



Blank, M., I Solomon, F. A tutorial 
language program to develop abstract 
thinking 1n socially dlsadvanf'ied 
preschool children. Child Development , 
1968, 39(2), 379-389. 



3/8/83 



83.46 



90.17 



92.10 



100 



■arisen, P. M. Comparison of th« occu- 
pational therapy approach for healing 
the young cerebral palsied child. 
Ame rican Journal of Occupational 
therapy , 1975, Z9, 267. 



3/30/83 



35.03 



86.62 



87.90 



100 



Harris, S. R. Effects of neurodevelop- 
mental therapy on motor performance of 
Infants with Down's syndrome. 0#v. 
dtedchlld Neurol.. 1981, 23, 4777"~ 



4/1/83 



84.21 



85.48 



87.16 



86 



O'Connell, J. C. , & Far ran, D. C. The 
effects of day care Intervention on tfc 
use of intentional conwunlcative _beha~ 
viqrs in socioeconomlcally depressed 
infants . Paper presented at the 
fllennlal Southeastern Conference of 
JJuman Development, Alexandria, 
|)1rg1n1a. 1980 (ERIC Document Repro- 
duction Service No. Ed 195 359) 13 pg. 



4/14/83 



90.10 



91.17 



93.46 



100 



Banta, T. W., Hlgglnbotham, L., & 
levin, M. Evaluation of East 
Tennessee's child health and ' 
development project" taper pre- 
sented at the annual meeting of 
^he American Educational Research 
Association, San Francisco, CA, 
1979. (ERIC Document Reproduction 
Service No. EO 175 174) 29 pg. 



Scott, R. Research and early childhood: 
The Home Start Project. Child Welfare , 
1974, 53(2), 112-119. 



ftarr-Salanatek, S., & Williams, M. L. 
a stimulation program for low birth 
weight Infants, American Journal, of 
Public Health, 1972, 62, 662-667. 



Puschlllo, J. C. Enriching the preschool 
exoeHence in children from age 3: The 
evaluation. Children , 1968, 15, 140-143. 



4/15/83 



85.03 



86.78 



87.74 



100 



4/20/83 



6/28/83 



9/17/83 



90.73 92.43 



79.2 



90.73 



80.0 



82.5 



87.90 



88.54 90.96 



67 



75 



56 



86.5 87,7 89.2 93.0 10 
Median Value 



7 5 4 



Total // 
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median value for the number of effect sizes chosen in common by various 
coders was 9356. The relatively high interrater consistency and the fact that 
checks of the computation and coding procedures were made for every article 
suggest a high level of consistency across the articles included in the meta- 
analysis. 

Finally, it was noted earlier that because means and standard deviations 
were not always reported in the article, alternative computational formula 
needed to be used. Since the logic of the standardized mean difference 
effect size is based on the use of standard deviation of the control group, 
it was felt to be important to check the degree to which the use of alterna- 
tive effect size computational formula might bias results. This was done by 
computing alternative effect sizes whenever an article provided enough infor- 
mation to compute an effect size using the means and standard deviation of 
the control group and to compute an effect size in other ways. The effect 
size used in the meta-analysis reported in the results section was always 
based on the means and standard deviation of the control group when that 
information was available. However, as shown in Appendix 2-G, in those cases 
where alternative forms of information were available, the average effect 
size was extremely close (usually within less than .05 of a unit). 

DATA ANALYSIS PROCEDURES AND RESULTS 

At this point, the data set for the meta-analysis consists of 1486 
standardized mean difference effect sizes (ES) from 156 studies (which have 
been reported in 261 different articles/reports). Seven hundred and nine of 
these effect sizes come from' studies which compared one type of intervention 
with another type of intervention (referred to below as intervention A vs. 
intervention B studies). For example, an early intervention research study 
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might have compared using parents extensively to supplement a center-based 
program with a center-based program without parent involvement. Seven 
hundred and seventy-seven additional effect sizes were from studies which 
compared an early intervention treatment to a no-treatment condition. Of 
these 777 effect sizes, 139 came from studies in which the subjects were 
diagnosed as handicapped, and 638 came from studies 1n which the subjects 
were diagnosed as disadvantaged or at-risk. As noted in the Procedures 
section, it was possible for a single study to contribute more than one 
effect size if various subpopulations were compared (e.g., the effects of the 
program on mentally retarded children were examined separately from the 
effects on speech impaired children), outcomes were measured at different 
points in time (e.g., immediate posttest vs. 6-month follow-up), or outcomes 
were assessed in different construct areas (e.g., language, IQ, motor, self- 
concept). As shown in Figure 2.2, the median number of effect sizes per 
study was 4.0. The largest number of studies yielded only one effect size, 
but there were several studies which yielded 30 or more effect sizes per ' 
study. 




5 10 15 20 

Figure 2.2. Number of. Effect Sizes Per Study 
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Studies Included in the meta-analysis were conducted between 1937 and 
1983 with over half of the studies having been reported since 1970. Most 
studies were reported in "educational/psychological" journals (54.556), with 
additional studies coming from "medical" journals (12.2*), books (7.7%), 
unpublished ERIC documents (9.9%), dissertations (.6%), and government 
reports (17.9%). The most commonly measured outcomes were IQ (which 
accounted for 42.5% of the effect sizes), academic or preacademic skills 
(14.8%), language (12.9%), and motor skills (8.2%). 54.8% of the outcomes 
came from studies which randomly assigned groups; 12.2% from well-matched 
control groups;' and the remainder from poorly matched or pre/post designs. 
Thirty-eight percent of the outcomes were measured by blind data collectors. 
Most outcomes were measured less than one month after the intervention was 
completed (60.9%), and only 11.2% were measured more than 36 months after the 
completion of the intervention. 

All of the analyses reported in this section are grouped by those 
studies which utilized disadvantaged or at-risk populations (hereafter 
referred to as disadvantaged) and those studies which utilized handicapped 
populations; therefore, it is important to understand more about the types of 
children and interventions included in these subcategories. In general, the 
quality of research conducted for disadvantaged populations is somewhat 
higher than the quality of research conducted with handicapped populations. 
As shown in Table 2.8, 62% of the outcomes for handicapped populations came 
from poorly designed studies, while only 30% of the outcomes for 
disadvantaged studies came from poorly designed studies. Only 18% of the 
outcomes for handicapped studies came from well -designed studies as opposed 
to 30% for the disadvantaged studies. 
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Handicapped 
(n » 139) 


Disadvantaged 
(n = 638) 


>) 


Good 


18% 


30% 


T3 
-M 








00 








M- 

C 


Fair 


20% 


40% 










Qua! 


Poor 


62% 


30% 
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Ninety-seven percent of the outcomes in the disadvantaged group are from 
populations classified as disadvantaged while 3% are from at-risk populations 
(defined in this meta-analysis as genetically or medically at-risk). Most of 
the children included in the handicapped study populations were categorized 
as mentally retarded (39% of the outcomes) or combination of handicaps (20%). 
Orthopedical ly impaired children was the next most frequently represented 
group (15%), followed by general developmental delayed, emotionally 
disturbed, speech and language impaired, other health impaired, and multiply 
handicapped, all of which accounted for less than 5% of the total number of 
effect sizes from handicapped groups. Consequently, references in the 
remainder of this Results section to handicapped populations are generally 
talking about children classified as mentally retarded (it is important to 1 
note that in most studies which had a combination of handicapping conditions, 
mental retardation was the most predominant category). 

Interventions classified as "educational" were the most frequent type of 
interventions for both handicapped and disadvantaged populations. However, 
for the disadvantaged populations, such interventions accounted for more than 

1 40 



90% of the outcomes Included 1n this analysis. For the handicapped 
populations, educational Interventions accounted for 51% of the outcomes, 
medical Interventions for 17%, diet for 8%, and stimulation for 8% with the 
remainder being a mixture of interventions which were not classified. 

In the remainder of the Results section, *we will demonstrate a process 
used in the analysis thus far. Much work remains to be done and literally 
hundreds of additional comparisons will need to be made. The work 
accomplished thus far represents the first step in the analysis process and 
shows what can be concluded from the most basic analyses. However, 1n 
summarizing the data from hundreds of studies such as 1s the case here, 1t 1s 
Important to try to disentangle the contributions of dozens of factors which 
are not independent from each other. Therefore, much additional cross- 
checking and testing of alternative explanations will need to be done during 
the second year of the Institute. Furthermore, there are still additional 
studies to be included in the meta-analysis data set. However, it 1s 
Important to note that at this point, the meta-analysis has already Included 
four times as many studies as any of the previous reviews which were examined 
during the first part of the project. Therefore, although the results should 
be viewed as tentative, they provide more evidence about the efficacy of 
early Intervention and which types of Intervention are most effective with 
which types of children than any of the previously reported reviews. 

"Cleaning" the Data Set ; 

After all coding was completed and data had been keypunched and 
verified, systematic checks of the data were made to Identify any remaining 
coding and/or keypunching errors. The next step was to compute "FREQUENCIES" 
for each of the variables included in the data set. In other words, the 
frequency with which each option for each variable was coded was depicted to 
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make sure that all scores fell within the possible limits for that variable. 

Mistakes were identified and corrected and then a random check of the data 

set was made by referring back to the original coding sheets. A small number 

of additional errors were identified and corrected. In total, corrections 

accounted for less than .08 of IX. Given these procedures and the procedures 

described in the previous section for checking the accuracy and consistency 

of coding, we are confident that the data set is clean and that it accurately 

represents the information presented in the studies thus far included. 

Average Standardized Mean Difference Effect Size 
For Each Level of Each Variable" 

Variables coded about each study were of two different types: (a) 

continuous data (such as, year in which the document was published ranged 

from 1937 to 1983), or (b) categorical variables (such as, degree to which 

intervention was tailored to child; 1 a no particular tailoring, 2 s somewhat 

tailored, 3 a substantially tailored). Based on the frequencies described 

above, each continuous variable was subcategorized into a discrete number of 

categories. For example, year in which the document was published was 

subcategorized into 1 ■ before 1965, 2 * 1966 through 1969, 3 a 1970 through 

1972, 4 * 1973 through 1975, 5 * 1976 through 1980, and 6 » 1981 and after. 

Using these categories, the average effect size for each level of each 

variable was computed separately for handicapped and disadvantaged 

populations. The results of this analysis are included In Appendix 2-H. To 

explain how the data in Appendix 2-H are organized, a section of the appendix 

is reproduced below in Table 2.9. As shown in Table 2.9, the data in 

Appendix 2-H show the number of data points on which each calculation is 

based and the average standardized mean difference effect size and the 

standard deviation of the data on which that average is based. For example, 
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Table 2.9 



Excerpt from Summary of Standardized Mean Difference 
Effect sizes for All Levels of Each Variable 



VARIABLE NAME 



PESCHPT10H/COOES 



i or am 

point! 



HANDICAPPED 



so 



oTTiTT 
potntt 



1-1 STUOVIO 



(10 I for each itudy) 



139 
T3T 



.S3 
75T 



.70 
770" 



638 



"?3T 



.42 



T4T 



1-3 YEAR 



Vc«r In which docurant wet published 



<6S 
66-69 
10-12 
73-75 
76-80 
81* 



16 

S 

24 
21 
SS 
16 



.76 
-.76 
.72 
.65 
.52 
.26 



.60 
1.25 
.78 
.73 
.SO 
.SS 



11 

216 
123 
ISO 
4S 
88 



.32 
.SO 
.S3 
.16 
.49 
.4S 



T4T 



1-4 SOURCE 1 



T3T 



"75T 



T70~ 



678 



Type of publication 

0 ■ educational Journal 

1 ■ radical journal 

3 ■ book 

4 ■ ERIC 

5 ■ dissertation/thesis 

7 ■ governrant report 

8 ■ other unpublished 



61 
39 
9 
14 

16 



.69 
.37 
.40 
.39 

.49 



.76 
.SS 
.69 
.31 

.92 



314 
60 
79 
23 

112 
40 



.36 
.76 
.41 
.62 

.37 
.41 



19-1 AGE0V1 



"TOT 



T5T 



T7T 



616 



Mean aga In wnths at which dependent variable Matured. 

1 ■ 0-12 ms 

2 ■ 13-24 

3 ■ 25-16 

4 ■ 37-48 

5 ■ 49-54 

6 ■ 55-60 

7 ■ 61-66 
B ■ 67-72 
9 ■ 73-84 

10 • 85-96 

11 • 97-108 

12 ■ 109* 

MISSIIir. DATA 



IS 
10 
18 
30 
13 
IS 
.7 
S 
I 
1 
2 
1 

21 



.37 
.50 
.44 
.56 
.02 
.71 
.10 

1.16 
.39 
.18 
-1.94 

-.16 



.57 
.41 
.71 
.66 
.66 
.71 
.34 
.43 
.00 
.00 
1.14 
.00 



26 
69 
63 

48 

17 
103 

22 

SI 

81 

56 

23 

57 
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^rjanmm 

ML 



741 



.49 

.33 
.54 
.74 
.84 
.43 
.68 
.29 
.43 
.37 
.37 
-.12 
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the average value of 139 effect sizes for handicapped populations was .53 
with a standard deviation of .70. The average value for 638 effect sizes 
from disadvantaged populations was .42 with a standard deviation of .59. 
These data suggest that on the average, collapsed across all types of 
studies, types of outcomes, and types of subjects, early intervention results 
in approximately a half a standard deviation gain. In other words, if 
accepted at face value, these data would indicate that the average child 
participating in an early intervention program would score at approximately 
the 69th percentile of a distribution of comparable children who did not 
participate in the early intervention program. 

Still referring to Table 2.9 under the disadvantaged category, the data 
for "year in which the document was published" shows that the average value 
for the 11 effect sizes published before 1965 was .32, the average effect 
size for the 216 effect sizes published between 1966 and 1969 was .50, etc. 
Results such as these were used mainly in deciding which variables to examine 
further. Therefore, they are not discussed in detail in this report but are 
included in Appendix 2-H as a reference for the reader to cross check results 
and raise additional questions. The reader is encouraged to become familiar 
with the format and content of this appendix. 

Average Standardized Mean Difference 
Effect Size for Key Variables 

Using the data from the analyses contained in Appendix 2-H, the next 

step in the analysis was to examine the average effect size for key variables 

identified in previous literature. This was done by recombining categories 

to avoid problems of instability due to small numbers of Effect Sizes and 

computing averages for these new categories. For example, year in which the 

document was published was recombined into three categories (i.e, before 
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1969, 1970 through 1975, and 1975 and after) Instead of the six categories 
originally created. This resulted 1n a larger number of effect sizes in each 
category and avoided problems of interpretation which result from 
Instability. Obviously, other types of recombinations are possible and may 
lead to different Interpretations of the results. Therefore, readers are 
encouraged to examine the influence of such combinations on variables in 
which they are particularly interested. 

The average mean difference effect size for the key variables suggested 
from previous literature 1s shown in Table 2.10. Variables included in this 
table are 1n the same order as they appear on the coding sheet, although not 
all variables in the coding sheet are Included 1n these results. 

For some variables, 1t would have been theoretically advantageous to 
have been able to have categorized them differently than they appear in Table 
2.10. For example, mean IQ prior to intervention 1s divided by those effect 
sizes which came from subjects below 85 and those. above 85. A theoretically 
stronger breakdown would have been 0 to 40, 41 to 55, 56 to 70, 71 to 85, 86 
to 100, and 101 to 115. However, breaking the data down 1n this way (which 
1s the way it appears 1n Appendix 2-H) would have left less than ten effect 
sizes 1n two categories for the handicapped and three categories for the 
disadvantaged. Therefore, the breakdown shown in Table 2.10 was used. 
Because the estimates are based on greater numbers of effect sizes and 
studies when the variable is broken down in this way, results are more 
believable, and one can place more confidence in any differences which are 
identified. 

Further Analyses of Key Variables 

Based on the conclusions from the analysis of previous reviews and the 
data reported 1n Table 2.10, five key variables were selected for more in- 
depth analyses. These variables; included: 
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Table 2.10 

AVERAGE STANDARDIZED MEAN DIFFERENCE EFFECT SIZE FOR KEY VARIABLES 
FOR EARLY INTERVENTION META-ANALYSIS 3 



Mean !Q Prior to Intervention 



Year 1n Which Document Was Published 





Handicapped 


Disadvantaged 




.43 
(23) 


.49 

(227) 


70-75 


.69 
(45) 


.33 
(273) 


75* 


• 

' .46 
(71) 


.47 

(133) 




Mean Age In Months at Which 
Oependent Variable Measured 




Handicapped 


Disadvantaged 


0-24 mos 


.42 (25) 


.37 (95) 


24-48 mos 


.52 (48) 


.63 (111) 


49-60 mos 


.85 (28) 


.49 (120) 


61+ mos 


.18 (17) 


.29 (290) 
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'Numbers In parentheses Indicate the number of effect slies on which 
average Is based* 
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Handicapped 


Disadvantaged 


Below 85 


.48 (37) 


.65 (74) 


Above 85 


.59 (34) 


.37 (381) 



Size of Sample 
Handicapped Disadvantaged 



0-10 


.70 (39) 


.70 (85) 


11-20 


.54 (59) 


.37 (207) 


21-30 


.42 (22) 


.47 (144) 


31-100 


.20 (17) 


.29 (192) 




Source of Participants 




Handicapped 


Disadvantaged 


Solicited/ 
Volunteer 


.42 (41) 


.38 (475) 


Referred 


.46 (43) 


.51 (46) 


Captive 


.86 (21) 


.38 (51) 



BEST COPY AVftKAILE 
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Severity of Handicapping Condition 



Handicapped 



Borderline/Mild 
Moderate 


.65 (44) 


Severe/Profound 


.31 (9) 


Mixed 


.49 (62) 



Primary Handicapping Condition of Sample 



Multiply Handicapped - (1) 

Hearing Impaired - (0) 

Visually Impaired - (0) 

Mentally Retarded .43 (54) 

Speech/Language ^ .70 (5) 

Learning Disabled * - (0) 
Orthopedlcally 

Impaired .35 (21) 



Other Health Impaired 
Emotionally Disturbed 
General Developmental 
Delay 

At ftlsk (generally or 

medically) 
Disadvantaged 
Other 

Combination 



.44 
.75 



(4) 
(7) 



.68 (7) 

.58 (20) 

.41 (618) 

1.08 (10) 

.58 (28) 



Percent of Sample Which 1s Black 
(Disadvantaged Only) 



ox 


.35 (35) 


1-50% 


.53 (29) 


50-90% 


.50 (166) 


90-100% 


.47 (241) 



best cow mum 

• • • • & 



% From One-Parent % with Father 

Homes Present in the Home 



(Disadvantaged Only) 



0-25% 


.33 


(50) 


.43 


(97) 


26-50% 


.45 


(58) 


51-10.0% 


.62 


(53) 


.42 


(61) 


76-100% 

» 




.28 


(52) 



Average Number of Children 1n Home 
(Includes Target Child) 

(Disadvantaged Only) 



< 2.0 


.44 


(488) 


2.1 - 3.5 


.33 


(108) 


3.6+ 


.32 


(42) 



Mothers: Average Number of Years Schooling Completed 
(Disadvantaged Only) 



< 10.0 grades 


.43 


(449) 


4* 

CO 


10.1+ grades 


.38 


(109) 
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Mean Age When Intervention Was Started 



0-6 mos 



7-18 mos 



Handicapped 



.35 (56) 



Handicapped 



.49 (38) 



.05 (18) 



Disadvantaged 



.43 (135) 



.39 



(73) 



19-36 mos 



.49 (32) 



.49 (32) 



.48 



(61) 



36-48 mos 
48-60 



.82 (26) 



.88 (11) 



.78 (17) 



.42 (131) 



.37 (225) 



Setting In Which Intervention Occurred 





Handicapped 


Disadvantaged 


Home 


.41 (38) 


.36 (116) 


Classroom 


.74 (32) 


.44 (383) 


Mixed 


.48 (37) 


.37 (117) 


Oegree to Which Intervention Was Tailored to Child 




Handicapped 


Disadvantaged 


None 


.40 (48) 


.42 


Somewhat or 
Substantial 


.61 (77) 


.39 
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Involvement of Parent as Intervenor 





Handicapped 


Disadvantaged 


Not at all 






or minor 


.59 (86) 


.42 (461) 


Major or 






only 


.40 (47) 


.38 (160) 





Training of Primary Intervenor 




Handicapped 


Disadvantaged 


Certified 


.78 (27) 


.44 (299) 


Not 






Certified 


.47 (65) 


.27 (244) 



Total Hours of Intervention 
(Hours Per Week X Number of Weeks) 





Handicapped 


Disadvantaged 


Small 

(0-50 hours) 


.88 


(14) 


.66 (30) 


Moderate 
(51-500) 


.71 


(15) 


.50 (119) 


Lots 
(500+) 


.68 


(9) 


.55 (193) 
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Degree of Structure In Instructional Curriculum 





(Disadvantaged Only) 




Very 


.50 (95) 


.41 


(460) 


Sorujwhat 


.39 (365) 


Not 


.29 (75) 


.29 


(75) 



To Whom Was Treatment Delivered? 



Handicapped Disadvantaged 



Child Only 


.56 


(77) 


.41 


(377) 


Parent and 










Child Together 


.49 

* 


(46) 


.39 


(227) 



Were Parents Given Written Plan of Weekly Activities? 
(Disadvantaged Only) 



No 


.17 (98) 




.44 (90) 



Chlld/Intervenor Ratio 
(Applies only to Classrooms) 



i. 0 
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Handicapped 



Disadvantaged 



Up to 1/1 


.80 


(28) 


.61 


(35) 


4/1 


.71 


(13) 


.33 


(62) 


8/1 




.29 


(176) 


8*/l < 


.60 


(11) 


.24 


(64) 



Intended Involvement Parents/Family 





Handicapped 


Disadvantaged 


None 


.84 


(33) 


.42 (280) 


Moderate/ 

Some 


.31 


(27) 


.42 (114) 


Extensive 


.49 


(63) 


.38 (216) 



Funding for Program 
Handicapped Disadvantaged 



External Funds 


.42 


(82) 


.39 


(578) 


No or Probably No 


.66 


(55) 


.73 


(48) 



Continued Intervention After Preschool 
(Disadvantaged Only) 



No 


.38 (129) 


Yes 


.16 (175) 



Type of Experimental Design Used 
Handicapped Disadvantaged 



Random or Good 
Matching 


.51 


(40) 


.39 


(407) 


Poor Matching, 
Pre/Post 


.53 


(92) 


.46 


(229) 



Blinding of Data Collector 

Handicapped Disadvantaged 



Yes, Definitely 


.50 


(37) 




.45 


(183) 


No, Definitely 


.45 


(24) 




.56 


(69 J 






Quality of Study 








Handicapped 




Disadvantaged 


1 & 2 (Good) 




.39 


(23) 




.40 


(185) 


3 




.47 


(28) 




.43 


(226) 


4 & 5 (Poor) 




.58 


(88) 




.42 


(227) 


Construct Measured by Outcome Variable 






Handicapped 




Disadvantaged 


I.Q. (1-4) 




.70 


(47) 




.44 


(291) 


Motor (5-8) 


.46 


(25) 




.49 


(39) 


Language 


.73 


(14) 




.50 


(82) 


Social Comp. 
13,14,17,18 


.42 


(27) 




.36 


(27) 


Illinois Test of 
Psycholinguists 
Abilities (15) 


.93 


(2) 




.65 


(42) 


Academic (16) 


.48 


(3) 




.21 


(98) 


Other (19-23) 




.50 


(20) 




.38 


(60) 



54 
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General Quality of Outcome Measure 

Handicapped Disadvantaged 



Good 

(1 and 2) 


.54 


(109) 


.42 


(586) 


Fair (3) 


.50 


(20) 


.33 


• (45) 


Poor (4 and 5) 


.56 


(10) 


.43 


(7) 



Months After Intervention Was Completed 
Outcome Measured 



Handicapped Disadvantaged 



Immediate 


.54 


(118) 


.54 


(118) 


.57 


(373) 


1 to 12 mos 






.09 


(6) 


.33 


(86) 


13 to 24 mos. 


.43 


(12) 


.52 


(2) 


.31 


(62) 


25 to 36 mos. 






.90 


(4) 


.28 


(24) 


37 to 60 mos. 




-.02 


(38) 


60+ mos, 






-.03 


(49) 



4* 
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• Degree of structure 1n the Intervention curriculum 

• Involvement of parents in . intervention programs 

• Training of the primary intervenor 

• Age at which intervention begins 

• Maintenance of benefits resulting from early intervention programs 
For each of these variables, a series of analyses were done to determine 
whether the data reported in Table 2.10 might be artifacts attributable to 
confounding with other variables. The best way to explain the analyses which 
were done for each of these variables is to go through the analyses iur 
"Degree of Structure" step by step. 

As will be recalled from Table 2.10, the data for disadvantaged 
populations with very structured programs had an average effect size of .50, 
somewhat structured programs an average effect size of .39, and programs with 
little or no structure had an average effect size of .29. These data suggest 
that more structured programs are more effective than less structured 
programs. However, it may be possible that degree of structure is confounded 
with other variables in such a way that these apparent differences are really 
attributable to some other variable. 

For example, assume for the moment that quality of study is strongly 
related to magnitude of effect size (assume very poor studies generally find 
higher effect sizes than good studies) and all of the effect sizes in the 
very structured category came from poorjy done studies, while all the effect 
sizes in .he category with little or no structure came from very good 
studies. If this were the case, the higher average effect size for very 
structured programs could more plausibly be explained by the quality of the 
study rather than the degree of structure in the intervention program. 
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Table 2.11 shows the types of analyses done to check such alternative 
explanations. Panel A reproduces • the average effect size for every level of 
"structure" (see numbers 1n the boxes), but also gives the standard error of 
the mean (defined as the observed standard deviation * the square root of the 
number of effect sizes), the number of effect sizes on which the calculation 
1s based, and the number of studies from which those effect sizes came. The 
standard error of the mean Is useful 1n determining how confident one can be 
that differences between levels are attributable to more than sampling 
fluctuation. A good rule of thumb is that values which do not differ by more 
than two standard errors of the mean are more likely attributable to sampling 
fluctuation than to true differences. The number of studies from which ES's 
come 1s important because one would be less confident 1n the results of 50 
ES's from two studies, t^an with 50 ES's from 25 studies. 

Panel A also shows the average value for each of seven different key 
variables for each level of "degree of structure". These data are used to 
determine whether observed differences 1n "degree of structure" might be 
attributable to differences on other key variables. For example, the average 
age at which the outcome was measured for very structured programs was 66.5 
months with information based on 93 of the 95 "very structured" effect sizes. 
The average age at which outcome was measured for somewhat structured 
programs was 69.4 with that data based on 357 of the 365 possible effect 
sizes. The average age at which outcome was measured for programs having 
little or no structure was 63.5 based on 73 of the 75 possible effect sizes. 
Thus, for this variable, there 1s little difference between age at which the 
outcome was measured for the three levels of "degree of structure". 
Continuing on down this list, there does seem to be substantial differences 
between time of measurement (months after treatment end) between the 



57 



r 7 * " ^ 

TABLE 2.11 

Further Analyses of Variables Associated With DEGREt OF 
STRUCTURE 1n the Intervention Procedure 



FOR VARIABLE: DEGREE OF STRUCTURE (see variable lll-Bb) 



58 




DISADVANTAGED 



re 



n 



es 



(n studies) 



.50 



.06 



95 (17) 
J (n) 



Age Outcome Measured 66.5 

MQ at Beginning of Tmt. 94.4 

Age Treatment Began 40.6 

Degree of Structure *** 

Quality of Study 3.3d 

Quality of Outcome 1.39 
Time of Measurement 

(months after tat, end) 14.1 



11!! 

(94) 



39 



.03 



3/5 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 



.29 



.06 



75 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



.... (33) 


If 


(n) 


69.4 


[357) 


87.2 


253 


31.7 


357; 


*** 




2.98 




1.60 




21.3 (365) 


(14) 


X 


(n) 


63.5 




91.5 


1 


48.7 




»** 




3.25 




1.52 


I'll 



3.6 (73) 



***Doe$ not apouar* In this table because It Is the same 
variable as the variable being analyzed. 

Panel A 



FOR VARIABLE: 

DEGREE J3f STRUCTURE (see variable III-8b) 



VERY STRUCTURED 



Se 
n 



• SO 
.06 
95 



SOMEWHAT STRUCTURED 
K -39 
Se .03 
n 365 



LITTLE OR HO STRUCTURE 
E5 -29 
Se 
n 



.06 
75 



Good 



15 (n) 

Igl ( 25 > 



Fair .16 (23) 



Poor .6L' (47) 



Good 



,38 



(129) 



F«1r .46 (132) 



Poor .33 (104) 



Good 



.12 



(12) 



Fair -44 (34) 



Poor -18 (29) 



TYPE OF MEASURE 



10 
(3) 



.69 
(12) 



.05 
(7) 



.48 

(25) 



.48 

(72) 



.45 
(56) 



.39 
(45) 



(3) 



.68 
(15) 



.02 
(13) 



Motor 
(7) 



(1) 



(2) 



(4) 



.31 
(14) 



.47 

(?) 



.20 
(5) 



(1) 



Language 
(10) 



(3) 



(2) 



(3) 



.35 
(18) 



.82 
(12) 



.48 
(17) 



(3) 



.27 
(6) 



.79 
(7) 



Social 
Compet. 
(13) 



(4) 



(2) 



(5) 



(2) 



(3) 



I TP A 
(15) 



.69 
(6) 



(2) 



.90 
(11) 



(3) 



.90 
(7) 



(3) 



(3) 



(2) 



.09 
(5) 



Academic 
(16) 



(3) 



.09 
(7) 



(4) 



means less than 5 ES's present In cell. 
"Oiank" means no ES's present in cell. 



Panel B 



BEST COf^ AVAILABLE 



.10 
(16) 



.40 
(21) 



.05 
(25) 



(3) 



(2) 



(2) 



Other 
(23) 



(1) 



(2) 



.30 
(6) 



.26 
(17) 



.53 
(5) 



(1) 



(1) 



59 



4* 



FOR VARIABLE: Written Plan for Home Intervention 
(see variable 1 1 1-1 2d) 



DISADVANTAGED 



15 



n es (n studies) 



17 



.06 



9a 



(10) 
(n) 



c 



S 



Age Outcome Measured 72.33 

!Q at Beginning of Tmt. 91.64 

Age Treatment Began 30.06 

Degree of Structure 2.03 

Quality of Study 2.96 

Quality of Outcome 1.36 

Ttnv of Measurement 27.03 
(month* after tmt. end) 



198) 
i'BO) 

9fl 

98) 
198) 
< 98 
'98) 



.05 90 



(7) 



L 
3 



Age Outcome Measured 
!Q at Beginning of Tmt. 
Age Treatment Began 
Oegree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



1 


(n) 


50.'26 


86 


89.76 


29 


14.60 


88 


1.97 


90 


3.11 


90 


1.81 


90 


17.91 


90 



□ 

X (n) 

Age Outcome Measured 
1Q at Beginning of Tmt, 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Ttirc of Measurement 
(months after tmt, end) 



Panel C 



ERLC 



GO 



TABLE 2.11 (continued) 



FOR VARIABLE: Written Plan for Hone Intervention 



(Disadvantaged -see variable 
IlM2d) 


10 
(3) 


Motor 
<7) 


TYP 

1 AnaUAOfi 

(10) 


E OF HEA1 

Social 
Compet. 
(13) 


iURE 

I TP A 
(15) 


Academic 
(16) 


Other 
(23) 


fJo Plan (0) 

Se .06 
n 98 


QUALITY OF STUDY 


Good 


13 
.29 


(n) 
(45) 


.49 
(19) 


(2) 


.37 
(12) 






-.18 
(12) 




Fair -.04 (16) 


-.IB 

(a) 






(») 




.05 

K) 


(i) 


Poor .12 (37) 


-.06 
(17) 


.28 
(5) 


(2) 


(2) 




.05 
(9) 


(2) 


Yes Plan Written (1) 

K M 
Se .05 
n 90 


Good 


,42 


(3?) 


.38 
(30) 










.55 
(7) 




Fair .49 (28) 


.70 
(18) 


-.21 
(7) 






(2) 


(i) 




Poor .42 (25) 


.54 
(15) 








(1) 


.05 
(?) 


(2) 


F5 
Se 
n 


Good Q 
















Fair 
















Poor 

















*** means less than 5 ES's present 1n cell. 
"Blank" means no ES's present In cell. 
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TABLE 2.11 (continued) 



Intervention A vs. Intervention B Comparisons of; 

OEGREE OF STRUCTURE 
(more versus less) 





IS 


Se 


"El 


Very Structured 
vs. 

Somewhat Structured 


.18 


.07 


58 


Very Structured 
vs. 

Not At All Structured 


.53 


.06 


51 


Somewhat Structured 
vs. 

Not At All Structured 


.01 


.0? 


22 



a ES's from 5 studies. 

Panel E 



62 



ER |c 8£$TIM AVAILABLE 



Intervention A v$ Intervention 8 Comparisons 
OEGREE OF STRUCTURE 
References 

Friedman, p., t Friedman, K. A. Accounting for Individual differences when 
comparing the effectiveness of remedial language teaching methods. 
Applied Psychollngulstlcs . 1980, 1, 15M70. 

Jason, L. A., I Klmbrough, C. A preventive educational program for young 
economically disadvantaged children. Journal of Community Psychology . 

1974, 2, 134-139. : 1 — 1 ~ 

Karnes, M. B., Teska, A., t Hodglns, A. S. The successful Implementation 
of a highly specific preschool Instructional program by paraprofeslonat 
teachers. The Journal of Special Education , 1969, 4, 69-80. 

Miller, L. B., I Oyer, J. L. Four preschool programs. • Their dimensions and 
effects. Monographs of the Society for Research In Child Oevelopment . 

1975, 40, Serial No. 1(2, Nos. 5-8. rrn 

Pytkowlci, A. R., I Selde, L. Children who failed Head Start. Mental 
Hygiene , 1968, 52, 386-39*. 



Panel F 



tn 



52 



different levels of "degree of structure". For very structured programs, the 
average time after the treatment ended in which measurement occurred was 14.1 
months; for somewhat structure programs, 21.3 months; and for programs with 
little or no structure, 3.6 months. From other data 1n the analysis, we know 
that outcomes which are measured close to the end of the treatment tend to be 
somewhat higher than outcomes- which are measured sometime after the treatment 
stops. Therefore, although there does appear to be some confounding between 
"degree of structure" and "time of measurement", eliminating the confounding 
would tend to further separate the groups than is now the case. 

Panel B shows additional analyses by breaking "degree of structure" down 
by "quality of study" and "type of measure". This time, numbers in the boxes 
show the average value for studies coded as "good" for very structured, 
somewhat structured, or little or no structure. As can be seen, the general 
trend for more structured programs to result 1n higher effect sizes is 
maintained and in fact further emphasized by these data. Unfortunately, 
there are only 12 effect sizes for programs with little or no structure which 
had good research designs. The data are further broken down by the type of 
measure, so that 1f we limit the analysis to just IQ measures fror-i very 
structured programs with good research designs, there is an average effect 
size of .69 based on 12 data points. Somewhat structured programs from 
studies having good research designs had an average effect size for IQ 
measures of .48 based on 72 effect sizes. There were only 3 IQ effect sizes 
from programs with little or no structure and good research designs, so this 
number is deleted from the table (values based on fewer than 5 effect sizes 
were deleted). However, the trend for more highly structured programs to 
result 1n higher effect sizes is maintained with the difference of .21 
between very structured and somewhat structured programs. Further analysis 



64 



53 



shows that the number and type of outcomes in each of these categories is 
very similar across the three degrees of structure. 

Another variable coded in the meta-analysis which provides additional 
information on the question of how degree of structure is related to 
intervention effectiveness, is whether the average effect size associated 
with home intervention programs provided a written plan for intervention to 
the parents. It was our assumption that programs which provided written 
instruction (including «chedules and criteria for progression and mastery) 
were more structured than programs which did not. As can be seen in Panel C, 
the average effect size for those programs which did provide such plans was 
.44 as opposed to .17 for programs which did not. Analyses of the average 
values on the key variables (also shown in Panel C) suggest that the average 
effect size for programs with written plans may be somewhat inflated since 
average time of measurement was 10 months earlier, studies were slightly well 
less done, and treatment began somewhat earlier. In general, however, these, 
data support the information in Panels A and B. Panel D provides a similar 
analysis for "written plan for home intervention" as Panel B provided for 
"degree of structure". When the analysis is limited to only good studies, 
the size of differences are somewhat reduced but the differences are in the 
same direction (i.e., favoring programs with written plans). 

Finally, Panel E shows the results of those studies which made within 
study comparisons of degree of structure. In other words, there were five 
studies included in the meta-analysis (see references in Panel F) which made 
a direct comparison between two or more interventions, one of which was more 
structured and one of which was less structured. As can be seen in Panel E, 
more structured programs resulted in more effective outcomes than less 
structured programs. The most striking difference is the comparison of very 
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54 

structured programs versus programs which were not at all structured, showing 
an effect size difference of .53 based on 51 effect sizes. 

As these analyses demonstrate, the integration of previous research to 
provide information about questions such as how degree of structure is 
related to intervention effectiveness is a complex task which requires 
extensive cross-checking of the data and exploration of alternative 
hypotheses. The data presented in Table 2.11 represent a much more complete 
analysis than has ever yet been reported in the literature. However, more 
analyses are possible and need to be conducted before we can be completely 
confident of the results. 

Similar analyses to those reported in Table 2.11 are reported in Table 
2.12 for involvement of parents in intervention programs, Table 2.13 for 
training of primary intervenor, Table 2.14 for age at which intervention 
begins, and Table 2.15 for maintenance of benefits resulting from early 
intervention programs. Each of these tables is organized in the same way as 
Table 2.11, with the exception that not all variables were addressed in the 
meta-analysis literature with intervention A vs. intervention B studies. 

DISCUSSION AND CONCLUSIONS 

Although additional data will be added to the meta-analysis during 
1983-84, some tentative conclusions are now possible based on the data 
currently available. These conclusions should be regarded as preliminary 
because more analyses are underway and additional data will be considered in 
the future. However, it should also be remembered that the current data set 
already includes more than four times as many studies as has ever been 
included in any single review of early intervention. Therefore, even though 

.$6 



TABLE 2.12 



Further Analyses of Variables Associated With 
INVOLVEMENT OF PARENTS in Intervention 
Programs 



FOR VARIABLE: 



Intended Involvement of Parents 
(see variable 111-17) 



00 

z 

UJ 
h* 
X 
UJ 



HANDICAPPED 



n es (n studies) 



^#9 



.08 



63 



~T 



Age Outcome Measured 43.07 

IQ at Beginning of Tmt. 87.60 

Age Treatment Began 22.43 

Degree of Structure 1.74 

Quality of Study 3.84 

Quality of Outcome 1.97 

Time of Measurement 2.11 
(months after tmt. end) 



23 
(n) 



(55 
(40) 
53 
42 
63 
63 
(57) 



DISADVANTAGED 



E5 



n es (n studies) 



.38 



.04 



216 



(23) 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



47.50 
95.08 
17.50 
1.99 
3.16 
1.82 
14.89 



(n) 

(208) 
(129) 

;aio 

166) 
216 
'216) 
(216) 



LU 
LU 



LU 

a 
o 

2E 



.31 



.07 



27 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



34.43 
70.14 
19.00 
2.17 
3.63 
2.41 
0.00 



10 
(n) 

23) 

7) 

23) 

6 \ 
27) 

27) 

24) 



.42 



.05 



114 



(11) 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



J 


(n) 


77.68 


(114) 


82.93 


(85) 


35.79 


(112) 


1.98 


(96) 


3.25 


(114) 


1.61 


(114) 


17.58 


(114) 



z 

o 



9 

ERIC 



.84 



.11 



38 



Age Outcome Measured 45.38 

IQ at Beginning of Tmt. 72.88 

Age Treatment Began 38.72 

Degree of Structure 2.00 

Quality of Study 3.71 

Quality of Outcome 1.58 

Time of Measurement 2.08 
(months after tmt. end) 



14 

(n) 

!29 

16 
;29 
(10 
'38 

38 
,38 



.42 



.04 



280 



(34) 



37 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



best copy mm 



J 


(n) 


72.79 


(268) 


90.40 1 


228) 


45.61 1 


[278 


1.95 


[266 


3.14 1 


280) 


1.46 1 


280 


15.92 1 


,277) 



TABLE 2.12 (continued) 



5G 



FOR VARIABLE: Intended Involvement of Parents 

(Handkaoped-* see variable 111-17) 





Extensive 


R 




Se 


.08 


n 


63 




Moderate 


R 


Ji 


Se 


.07 


n 


27 




Some 


K 


.84 


Se 


.11 


n 


38 



TYPE OF MEASURE 



IQ 
(3) 



Motor 

(7) 



Language 

(10) 



Social 
Coinpet. 
(13) 



I TP A 

(IS) 



Ac ademlc 
(16) 



Good 



I? (n) 
(10) 

.23 



.10 
(6) 



(1) 



(1) 



Fair ,45 (15) 



(2) (2) 



Poor ,60 (36) 



.67 
(19) 



Good 



35 (5) 



Fair .14 (5) 



Poor .34 (17) 



(4) 



Good 



.63 



(8) 



(2) 



Fair .78 (7) 



Poor .93 (23) 



1.08 
(10) 



(2) 



.26 
(8) 



(4) 



(1) 



(2) 



.35 
(5) 



.14 

(5) 



(4) 



(2) 



(1) 



(2) 



(4) 



11L 



9? 
(5) 



(4) 



(2) 



(D 



(D 



(1) 



"-" means less than S ES's present in cell. 
"Blank* means no ES's present in cell. 



FOR VARIABLE: Intended Involvement of Parents 

(Oisadvantaged—see variable 111-17) 



TYPE OF MEASURE 



IQ 
(3) 



Motor 
(7) 



Language 
(10) 



Social 
Compet. 
(13) 



I TP A 
(IS) 



Academic 
(16) 



Other 
(23) 



Extensive 



J3 

Se .04 
n 216 



Moderate/ Some 

Se -05 
n 114 



None 
E5 M 
Se -04 
n 280 



Good 



■ft (n) 
(60) 



,15 



.42 
(41) 



(1) 



(3) 



(2) 



Fair .41 (92) 



.45 
(41) 



-.05 
(10) 



.60 
(10) 



.69 

(7) 



(2) 



Poor .29 (64) 



.19 
(34) 



(3) 



(6) 



(2) 



(1) 



Good 



32 (50) 



.53 
(20) 



.31 
(13) 



(1) 



Fair .43 (15) 



.45 
(9) 



(1) 



(2) 



Poor .52 (49) 



.70 
(16) 



(3) 



.45 
(13) 



(2) 



Good 



.10 



(65) 



.50 
(25) 



(4) 



,20 
(8) 



(2) 



,«2 
(12) 



Fair .13 (111) 



.45 
(35) 



.56 
(10) 



.53 
(15) 



.02 
(10) 



.78 
(7) 



Poor .41 (104) 



.37 
(53) 



1.23 
(6) 



.53 



,57 
(13) 



.52 
(8) 



.15 
(10) 



..02 
(10) 



-.18 
(14) 



.20 
(8) 



.22 
(9) 



.44 
(21) 



.10 
(15) 



.39 
(5) 



.46 

(UD 



.51) 
(8) 



(1) 



(3) 



.68 
(7) 



.20 
(5) 



.33 
(13) 



(4) 



•-" means less than S ES's present In cell, 
"Blank" .means no ES's present in cell. 
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TABLE 2.12 (continued) 



FOR VARIABLE: Involvement of Parent as Intervener (see variable III-4A) 



HANDICAPPED 



DISADVANTAGED 



4J 

ro 

4J 

o 

C 

U 
O 

o 
c 



S e n es (n studies) 



IS 



S e n es (n studies) 



,59 



.063 



86 



.42 



.028 461 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Oegree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



X 


(n) 


'50.23 


(74) 


83.35 


(46) 


31.79 


(75) 


1.95 


(42) 


3.73 


(86) 


1.99 


(86) 


1.21 


(85) 



Age Outcome Measured 
IQ at Beginning of Tmt. 
'Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



7 


(n) 


70.69 < 


[443) 


89.09 < 


[361) 


40.78 < 


451) 


1.96 1 


[407) 


3.15 1 


[461) 


1.52 1 


[461) 


15.3 (456) 


X 


(n) 



c 
o 

o 

i. 
o 

•n 



,40 



.058 



47 



.38 



.044 



160 





J 


(n) 


Age Outcome Measured 


32.79 


(38) 


IQ at Beginning of Tmt. 


78.16 


(19) 


Age Treatment Began 


10.14 


(35) 


Degree of Structure 


1.63 


(22) 


Quality of Study 


3.79 


(47) 


Qual ity of Outcome 


1.79 


(47) 


Time of Measurement 




(months after tmt. end) 


2.46- 


(39) 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



46.21 
95.68 
13.34 
2.01 
3.21 
1.94 



(156) 
( 82) 
(158) 
(125) 
(160) 
(160) 



'6.59 (160) 



o 
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TABLE 2-11 (continued) 



58 



FOR VARIABLE: Involvement of Parent as Intervenor 
(Hand (capped —see variable 1 1 1 - 4a ) 



TYPE OF MEASURE 



IQ 

(3) 



Motor 
(7) 



Language 

(10) 



Social 
Compet. 
(13) 



ITPA 
(15) 



Academic 
(16) 



Other 
(23) 



Minor or not at all 

R jso 
Se .065 
n 84 



Major or only 

K jo 

Se .058 
n 47 



Good 



IS (n) 
(17) 



.38 



.10 

I 8) 



(3) 



1.19 
( 5) 



Fair .50 (18) 



(1) 



(2) 



(4) 



Poor .71 (49) 



1.01 
(19) 



.78 
( 9) 



.62 
8) 



.17 
6) 



(2) 



Good 



.43 



6) 



.352 
( 5) 



Fair .46 ( 9) 



(3) 



(1) 



.05 

( 5) 



Poor .37 (32) 



.40 
(16) 



.24 

( 9) 



(?) 



(2) 



(1) 



(2) 



(1) 



.30 
(10) 



(3) 



(1) 



(3) 



"•" means less than 5 ES's presertt (n cell. 
"Blank" means no ES's present In cell. 



FOR VARIABLE: Involvement of Parent as Intervenor 



(D)sadvantaged--see variable III-4a) 


IQ 
(3) 


Motor 
(7) 


TYP 

Language 

(10) 


E OF MEAJ 

Social 
Compet. 
(13) 


>URE 

ITPA 
(IS) 


Academic 
(16) 


Other 
(23) 


Minor or not at all 

ET- ^42 
Se .03 
n 461 


-i 
o 
ec 
h- 
X 

O 
u 

u. 
o 

>■ 
< 

=3 

c 


Good 


.39 


(n) 
(127) 


.57 
(56) 


.38 
( 5) 


.31 
(24) 


(2) 


.62 
(12) 


-.02 
(23) 


.20 
( 5) 


Fair .44 (170) 


.42 
(63) 


.57 
(13) 


.58 
(21) 


.IS 
(15) 


.79 
( 9) 


.36 
(28) 


.34 
(21) 


Poor .43 (164) 


.39 
(76) 


.99 

( 9) 


.51 
(26) 


(2) 


.57 
(18) 


-.01 
(19) 


.45 
(14) 


Major or only 

ET JI 
Se -01 
n 160 


Good 


.42 


(54) 


.33 
(36) 


(i) 




(3) 




.52 

( 3) 


.69 
( 6) 


Fair .41 (50) 


.60 
(24) 


-.16 - 

( 8) 


(4) 


(2) 


(2) 


(3) 


.32 
( 7) 


Poor .32 (56) 


.34 
(29) 


(3) 


(3) 


(5) 


(1) 


.10 
(13) 


.38 
( 5) 



"-" means less than 5 ES's present In cell. 
"Blank" means no ES's present In cell. 
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FOR VARIABLE: To whom was treatment delivered? 

(see variable 111-10) 



7i 



DISADVANTAGED 



! es 



(n studies) 



.03 



377 



Age Outcome Measured 
IQ at Beglnnlnj of Twt. 
Age Treatment Began 
Degree of Structure 
Quality of* Study 
Quality of Outcome 
Jim of Measurement 
(months after tat. end) 



(42) 


I 


(n) 


74.03 I 


359 


88.31 


300 


44.77 


368 


1.97 \ 


341 


3.06 


377 


1.49 


377 


15.19 (371) 



39 



.03 £77 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



(28) 


J 


M 


50.52 I 


223 


94.76 


124 


15.73 


225 


1.97 


179 


3.34 < 


227 


1.80 | 


227 



17.27 (227) 



□ 



Ige Ou 

IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



(n) 



9 
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BEST COPY AVAILABLE 



TABLE 2.12 (continued) 



FOR VARIABLE: To whom was treatment delivered? 

(Disadvantaged— see variable 111-10) 



TYPE OF MEASURE 



IQ 
(3) 



Motor 
(7) 



Language 
(10) 



Social 
Compet. 
(13) 



ITPA 
(15) 



Ac ademlc 
(16) 



Child only 



IS" .41 
Se .03 
n 37/ 



Parent and Child 

IS J9 
Se -03 
n 227 



ES 
Se 
n 



Good 



R (n) 
'(113) 



.37 



.51 
(46) 



.52 
( 5) 



.29 
(22) 



(3) 



.62 
(12) 



-.10 
(19) 



Fair .47 (137) 



.50 
(50) 



.54 
(11) 



.61 
(10) 



.04 
(6) 



.79 
(9) 



.42 
(23) 



Poor .38 (127) 



.38 
(60) 



.88 
(5) 



.44 

(20) 



.57 
(18) 



.12 
(17) 



Good .48 (65) 



.48 
(45) 



(1) 



(4) 



(2) 



.52 
■(8) 



Fair .28 (69) 



.28 
(34) 



.02 
(10) 



13) 



.72 
(6) 



.11 
(8) 



Poor .40 (93) 



.34 
(44) 



.29 
(6) 



.90 
(10) 



(4) 



(1) 



.05 
(16) 



Good 



□ 



Fair 



Poor 



H . w means less than 5 ES*s present In cell. 
"Blank 11 Means no ES's present In cell. 



TABLE 2.12 (continued) 
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FOR VARIABLE: Settings of Intervention (see variable 1 1 1-2) 



HANDICAPPED 



DISADVANTAGED 



S e n es (n studies) 



S e n es (n studies) 



UJ 

o 



o 
§ 

GO 

on 
< 



Q 
UJ 
X 



.09 



38 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



37.83 
77.32 
18.77 
1.88 
2.84 
2.18 



(11) 
(n) 

(36) 
( 9) 
* 35) 
8) 
38 
38 



.16 (37) 



.12 



32 



(16) 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



J 
45.48 
71.50 
40.04 
1.82 
4.00 
2.13 

1.23 



(n) 
(25) 
( 4) 
(25) 

® 

(32) 
(31) 



48 



.11 



37 



(13) 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Oegree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



42.72 
91.47 
18.32 
1.77 
4.30 
1.95 



(n) 

(32) 

(30 

(34) 

(30) 

(37) 

(37) 



3.26 (35) 



.36 



05 



116 



(19) 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



X 


(n) 


40.43 


(116) 


94.00 


( 65) 


15.24 


(114) 


2.00 


( 96) 


2.99 




1.93 


iiiSi 


11.81 


(116) 



.03 



383 



(44) 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



71.36 
90.07 
41.37 
1.95 
3.17 
1.59 

15.46 



(n) 

(375) 
(303) 
(374) 
(326) 
(383) 
(383) 

(379) 



.37 



.05 



117 



(12) 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tint, end) 



Y 


(n) 


67.53 


(113) 


88.06 


( 80) 


28.78 


(115) 


1.96 


(113) 


3.22 


(117) 


1.43 


(117) 


20.21 


(117) 
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FOR VARIABLE; Setting of Intervention 

(Han41capped--see variable UN2) 





Home 


R 


.41 


Se 


.09 


n 


38 




Classroom 


R 


.74 


Se 


.12 


n 


32 




Mixed 


R 


A9 


Se 


.11 


n 


36 



TYPE OF MEASURE 



10 
(3) 



Motor 

(7) 



Language 
(10) 



Social 
Compet. 
(13) 



I TP A 
(15) 



Academic 
(16) 



Other 
(23) 



Good 



R (n) 
13 (l5) 



.10 
(6) 



(1) 



.45 
(6) 



Fair .56 (12) 



(3) 



(2) 



.28 
(6) 



Poor .43 (11) 



.35 
(6) 



(2) 



(2) 



(1) 



Good i 25 



(4) 



(4) 



Fair .78 (8) 



(2) 



(3) 



Poor .62 (20) 



1.03 
(7) 



(2) 



(4) 



(1) 



(1) 



(1) 



Good 



□ 



Fair .01 (7) 



(1) 



Poor .61 (29) 



.74 
(13) 



.24 
(8) 



(1) 



"-" means less than 5 ES's present In cell. 
"Blank" means no ES's present In cell. 

fQR VARIABLE: Settings of Intervention 

(01sadvantaged--see variable X Z 1-2 ) 





Home 


R 


J6 


Se 


.05 


n 


116 




Classroom 


R 


.44 


Se 


.03 


n 


383 




Mixed 


R 


JZ 


Se 


.05 


n 


117 



TYPE OF MEASURE 



10 
(3) 



Motor 
(7) 



Language 

(10) 



Social 
Compet, 
(13) 



I TP A 
(15) 



Academic 
(16) 



Other 

(23) 



(2) 



(1) 



(3) 



(3) 



-.02 
(6) 



(3) 



Good 



FJ (n) 
(34) 



.44 
(26) 



(1) 



(2) 



(1) 



(3) 



(1) 



Fair .34 (52) 



.47 
(29) 



-.16 

(8) 



(4) 



(2) 



(2) 



(1) 



.17 
(6) 



Poor .27 (30) 



.02 
(11) 



(3) 



.79 
(7) 



(3) 



.39 
(6) 



Good 



.43 



(92) 



.58 
(40) 



(4) 



.26 
(14) 



(4) 



.66 

(11) 



.16 
(12) 



.21 

(7) 



Fair .47 (156) 



.47 
(55) 



.57 
(13) 



.59 
(21) 



.25 
(14) 



.76 
(7) 



.44 

(23) 



.35 
(23) 



Poor .41 (135) 



.36 
(65) 



.88 
(5) 



.44 
(20) 



(2) 



.57 
(19) 



.12 
(17) 



.43 
(7) 



Good 



.26 



(S3) 



.37 
(27) 



.34 
(10) 



.03 
(16) 



Fair .33 (18) 



.45 

(6) 



(1) 



(1) 



(2) 



.06 

(7) 



(1) 



Poor .51 (46) 



.62 
(21) 



(3) 



(3) 



(2) 



.07 
(13) 



(4) 



"-" means less than 5 ES's present In cell. 
"Blank" means no ES's present in cell. 
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TABLE 2.12 (continued) 



Intervention A vs. Intervention B Caparisons of*: 

DEGREE OF PARENTAL INVOLVEMENT 
(More versus Less) 





F5 


Se 


°ES 


All Comparisons 

No Parent vs. Parent 
or 

Less vs. More 


.08 


.05 


134 


Gordon Study Only 
Major Intervener 
vs. 

Only Intervrnor 


.18 


.06 


70 


All Comparisons Except Gordon Study 
No Parent vs. Parent 
or 

Less vs. More 


-.06 


.09 


64 



d tS's from 9 studies. 



Intervention A vs Intervention 8 Comparisons 
DEGREE OF PARENTAL INVOLVEMENT 
References 
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through training their mothers. Archives of Disease In Childhood . 1975, 
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Gordon, I. J, Stimulation via parent education. Children , 1969, 16, 57-58. 

Karnes, M. fi., Teska, J. A., Hodglns, A. S., i Badger, E. 0. Educational 
Intervention at home by mothers of disadvantaged Infants. Child 
Development . 1970, 41, 925-935. 

McCarthy, J. L. G. Changing parent attitudes and Improving language and 

Intellectual abilities of culturally disadvantaged four-year-old children 
through parent Involvement , Unpublished Doctoral Dissertation. 
Bloomlngton, Indiana: Indiana University, 1968. 

Miller, L. B., t Dyer, J. L. Four preschool programs: Their dimensions and 
effects. Monographs of the Society for Research in Child Development . 
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Nedler, S., t Sebra, P. Intervention ftratlglts for Spanish-speaking pre- 
school children. Child Development , 1971, 42, 259-267. 

Radln, N. Three degrees of parent Involvement In a preschool program; Impact 
on mothers and children . Paper presented at the annual meeting of the 
Midwestern Psychological Association, Detroit, Michigan, 1971. (ERIC 
Oocument Reproduction Service No. ED 052 831) 
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TABLE 2.13 

Further Analyses of Variables Associated 
With TRAINING OF PRIMARY INTERVENOR Delivering 
Intervention Services 



63 



FOR VARIABLE: TRAINING OF PRIMARY INTERVENOR-- (see variable 1 1 1-5) 



HANOICAPPED 



TS 



n eS (n studies) 



DISADVANTAGED 



E5 



n es (n studies) 



Q 
LlJ 



LbJ 
O 



.78 



.09 



27 



14 

(n) 



.03 



299 



37 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



50.31 
70.90 
48.65 
1.94 
4.19 
1.67 
1.46 



iiS) 



16 

10) 
17) 
17) 
27) 
27) 
(26) 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



X 


(n) 


66.41 I 


[292) 


88.77 1 


;408) 


39.49 1 


[293) 


1.99 I 


!279) 


2.93 I 


;299) 


1.57 


299) 


8.08 1 


'243) 



LU 



LU 

o 



.47 



.09 



65 



t. 



Age Outcome Measured 
IQ at Beginning of 
Age Treatment Bega. 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



42.84 
85.69 
14.87 
1.84 
3.54 
' 1.92 
2.68 



21 

(n) 

(56) 
33) 
(53) 

S] 

(65) 
(57) 



.27 



.02 



244 



30 

X (n) 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



61.66 
92.59 
24.94 
1.88 
3.33 
1.70 
25.50 



(239) 
(248) 
(242) 
203) 
(244) 
(244) 
(243) 



4 
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TABLE 2.13 (continued) 



(Hand1capped--see variable I II- 5) 


IQ 
(3) 


Motor 
(7) 


TYF 

Language 

(10) 


>E OF MEA2 

Social 
Compet. 
(13) 


>URE 

I TP A 
(15) 


Academic 
(16) 


Other 
(23) 


Certified 

Se .09 
n 25 


>» 

o 

i/i 

u. 
o 

>- 

-J 
< 

Or 


K (n) 
fc* .83 (25) 


.71 
(6) 




(2) 


(1) 








Fair 
















Poor .86 (19) 


.54 
(6) 


(4) 


(4) 


(1) 


(1) 


(I) 


(1) 


Not Certified 

Se .09 
n 75 


M Q d4) 


.10 
(6) 






.58 
(7) 






(1) 


F|1r .26 (16) 


(3) 


(i) 




.05 
(5) 




(1) 


-.02 
(6) 


Po0r .60 (35) 


.84 

(17) 


.15 

(8) 


(4) 


(2) 


(I) 




,(3) 


"-" means less than 5 ES's 


pre 


sent in cell . 



"Blank'* means no ES's present in cell. 



FOR VARIABLE: TRAIN IMG OF PRIMARY INTERVENE 

(Disadvantaged— see variable III-5) 



TYPE OF MEASURE 



IQ 
(3) 



Motor 

(7) 



Language 
(10) 



Social 
Compet* 
(13) 



I TP A 
(15) 



Academic 
(16) 



Other 
(23) 



Certified 



H ^44 
Se .03 
n 299 



Not Certified 

Se .02 
n 244 



Good 



Good 



Poor 



ET (n) 
(120) 



40 



.61 
(50) 



.38 
(5) 



.31 
(26) 



(2) 



.75 
(9) 



Fair .43 (87) 



.54 

(36) 



(1) 



.61 
(13) 



.06 
(11) 



(3) 



Poor ,50 (92) 



.59 
(38) 



.42 
(5) 



.48 
(20) 



.54 
(15) 



.40 



(63) 



.33 
(44) 



(1) 



(3) 



(1) 



Fair .24 (75) 



.29 
(36) 



.06: 

(10) 



(3) 



(2) 



.21 U2&1 



.09 
1521 



.67 



(2) 



_(£)_ 
(4) 



-.02 

(23) 



.37 
(8) 



.28 
(5) 



.52 
(8) 



.06 
(16) 



.05 

JUL 



.20 
(5) 



.21 
(15) 



.29 
(9) 



.69 

(6) 



,33 
(6) 



.48 



"-" means less than 5 ES's present 1n cell. 
"Blank" means no ES's present in cell. 



78 



TABLE 2.14 

Further Analyses of Variables Associated With 
AGE AT WHICH INTERVENTION BEGAN 



65 



FOR VARIABLE: Age at Start— (see variable III-l) 



HANDICAPPED 



IS 



n es (n studies) 



01 
4-» 

c 

00 
I 

o 



,35 



.10 



56 



(13) 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Oegree of Structure 
quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



J 


(n) 


33.88 


(56) 


85.84 


(37) 


2.00 


(24) 


3.73 


(56) 


1.98 


(56) 


2.18 


(56) 



C 



CO 
I 

CO 



.49 



.11 



32 



(12) 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Oegree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



I 


(n) 


43.45 


(31) 


66.38 


(16) 


1.45 


(11) 


3.91 


(32) 


2.22 


(32) 


1.22 


(32) 




(13) 


J 


(n) 


57.88 


(26) 


92.00 


(13) 


1.87 


(15) 


3.54 


(26) 


2.00 


(26) 


0.00 


(26) 



JZ 

c 



I 

CO 



SSI 



.13 



26 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcor.ie 
Time of Measurement 
(months after tmt. end) 



o 

ERIC 
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TABLE 2.14 (continued) 



FOR VARIABLE: Age at Start (see variable lll-l) 



B 

so 

4 



§ 



DISADVANTAGED 



E3 



n es (n studies) 



0 



.04 



135 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



38.96 
109.60 

1.94 
2.83 
1.87 

12.47 



[12) 
(n) 

(133) 
( 20) 

135 i 
(135) 

(133) 



.39 



.07 



73 



(14) 



Age Outcome Measured 
IQ At Beginning of Tmt, 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



.'18 



.07 



61 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 





(n) 


35.07 




92.55 


181 


1.99 


(69) 


3.12 


73 


1.78 


(73) 


8.93 


(73) 




(12) 




(n) 


60.13 




88.67 


m 


1.90 


(50) 


3.61 


61 


1.67 


(61) 


21.85 


(61) 



FOR VARIABLE: Age at Start 



DISADVANTAGED 



n es (n studies) 



.42 



.06 



131 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Oegree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



72.71 
87.53 

1.95 
2.54 
1.61 



(19) 
(n) 

if! 

(120) 
131 
(131) 



8.74 (131) 



.04 



225 



Age Outcome Measrrod 
IQ at Beginning of Tmt. 
Age Treatment Began 
Oegree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



85.48 
90.14 

1.98 
3.65 
1.44 



(20) 
(n) 

»! 

(195) 
225 
(225) 



21.52 (225) 
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TABLE 2.14 (continued) 



FOR VARIABLE: Age at Start lt . „,., 

(Hand1capped--(see variable III-i) 



TYPE OF MEASURE 





0-18 months 


IS 


.35 


Se 


.10 


n 


56 




18-36 months 


15 


.49 


Se 


.11 


n 


32 




36-66 months 


13 


.89 


Se 


.13 


n 


26 



Good 



IS (n) 



Fair ,18 (15) 



IQ 
(3) 



Motor 
(7) 



Language 
(10) 



a 

h- 

00 

u. 
o 

>- 

h- 

-I 
< 

cr 



Poor .41 (35) 



Good 



.07 



(10) 



Fair 



Poor .68 (22) 



(2) 



,48 
(17) 



.10 
(8) 



Good 



.92 



(6) 



Fair .82 (7) 



Poor .90 (13) 



1.14 
(8) 



1.03 
(6) 



(1)' 



.34 

(6) 



(2) 



(4) 



(1) 



(1) 



.82 

(5) 



(4) 



(1) 



(3> 



Social 
Compet. 
(13) 



.35 
(5) 



.05 
(5) 



(3) 



(2) 



(4) 



(4) 



(2) 



I TP A 
(15) 



Academic 
(16) 



(1) 



(1) 



"-" means less than 5 ES's present In cell, 
"Blank" meant', no CS's present In cell. 



(1) 



(1) 



(1) 



Other 
(23) 



(1) 



..02 
(6) 



(3) 



(3) 



(1) 



(1) 
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TABLE 2.14 (continued) 





(3) 


4,\ tor L 

(7) 


TYPE 

anguage 

(10) 


OK HEASUf 

Social 
Cotnpet. 
(13) 


IE 

ITPA A< 
(IS) 


zadunic 
(16) 


Other 
(23) 


0-6 months 
Se .W 

ft 135 S 


Good 


IS 
47 


(n) 
(62) 


.50 
08) 


(4) 




.22 
(5) 




.53 
(5) 


.43 
(10) 


Fair .36 (42) 


.22 
(14) 


.05 
(7) 


(i) 


.68 

(7) 




(1) 


.52 
(12) 


Poor .44 (31) 


.69 

(7) 




(2) 


(4) 




.11 
(10) 


.32 
(8) 


6-18 months ^ 

B A a 
Sa .07 


Good | 




(22) 


.52 
(14) 


(5) 


(i) 






(2) 


(i) 


Fair .29 (25) 


.42 
(10) 


.34 

(6) 


(2) 


(2) 




(2) 


(3) 


'> Poor (26) 


.38 
(16) 


.28 
(5) 


id) 






(2) 


(2) 


•I 

18-36 months - 
c 

Se -07 
n 61 


c 

3 Gord , ( 7 ) 

y .J 


.36 
(6) 










(I) 




Fair .63 (26) 


.69 
(17) 




(4) 




(i) 


1 (2) 


(2) 


Poor .38 (28) 


.28 
(20) 


(i) 








1 {l) 


.75 
(6) 


36-4S months 

B 

Se -06 
n 131 


mi 

Z Good 


IS 

H 


(n> 
] (67) 


.55 
(25) 




♦ 4 J 

(17) 




.74 

(9) 


-.07 
(16) 




3t 

° Fair .25 (38) 


.51 
(11) 




J2i 


-.09 
(8) 


w 




-.04 
(ID 


CJ 
U. 

o Poor .83 (26) 


.88 

n 


("d 


.48 
(15) 




(2) 






48-66 months 

B Jl 
Se .04 
n 225 


>• 

Z Sood 


.26 


(25) 


.25 
(ID 




.46 

(7) 






I .09 
(7) 




< 

Z fair .44 (87) 


.35 
(35) 


.4; 

(8) 


.63 
(13) 




.78 
(7) 


.34 
(22) 


(2) 


Cr 

j Poor .33 (113 


.30 
) (56) 


.88 
(5) 


.53 
(9) 


.1— 


.38 
(17) 


.22 
(23) 


<» 



means less than 5 ES's present 
"Blank" means no ES'S present In c 
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TABLE 2.14 (continued) 



Intervention A vs. Intervention B Comparisons of d : 

AGE AT WHICH INTERVENTION BEGINS 
(Younger versus Older) 





B 


s e 


"ES 


All Comparisons 


.08 


.05 


104 


Gordon Study 
IQ Only 


.09 


.08 


62 


Gordon Study 
Caldwell Preschoot 
HOME 


.02 


.09 


28 



^ES's from 7 studies. 
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TABLE 2.15 



Further Analyses of Variables Associated with MAINTENANCE OF 
BENEFITS Resulting from Early Intervention Programs 



FOR VARIABLE: Time after Intervention, 
Outcome Measured 
(D1sadvantaged--(see variable V-1Z) 



DISADVANTAGED 



n oS (n studies) 



.28 



.07 



62 



Aye Outcome Measured 
IQ at Beginning of Tint. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Tiire of Measurement 
(moLths after tmt. end) 





(21) 


X 


(n) 


78.83 


(24) 


86.36 


(ID 


28.46 


(24) 


1.96 


(24 


2.83 


(24 


1.S8 


(24) 



.02 



.09 



38 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after tmt. end) 



(7) 




(n) 


99.61 1 


30) 


06.77 l 


30) 


34.74 


38) 


1 .89 \ 


38 


2.71 


38) 


1.76 


[38) 



.03 



.07 



49 



Age Outcome Measured 136.43 

IQ at Beginning of Tmt. 93.29 

Age Treatment Began 34.88 

Degree of Structure l .84 

Quality of Study 4.02 

Quality of Outcome 1 .49 
Time of Measurement 
(months after tmt. end) 



(4) 
(n) 

!49) 
31) 
49 
49) 

181 



DISADVANTAGED 



FS 



n e$ (n studies) 



.03 



373 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
lime of Measurement 
(iponths after tmt. end) 



(64) 


X 


(n) 


47.11 | 


356) 


91 . 25 


280) 


32.39 i 


364 


1.95 < 


292 


3.10 i 


373 


1.57 i 


373) 



.05 



86 



Age Outcome Measured 
IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months afte* tmt. end) 





(18) 






(n) 


65.74 




86) 


89.48 




58) 


39.17 




86 


2.11 




71 


3.40 




86 


1.76 




86) 



31 



.05 



62 



W Ou 

IQ at Beginning of Tmt. 
Age Treatment Began 
Degree of Structure 
Quality of Study 
Quality of Outcome 
Time of Measurement 
(months after 4 tmt. end) 



> (21) 


X 


(n) 


75.48 | 


62) 


66.35 < 


43 


36.69 


62 


1.97 


58 


2.98 


62 


1.87 i 


62! 



85 



TABLE 2.15 (continued) 



71 



FOR VARIABLE: Time after Intervention, 



Outcomt Measured 
(D1sadvantaqed<*«($ee variable 
W2) 


IQ 
(3) 


Motor 
(7) 


TYP 

Language 
(10) 


E OF MEA! 

Social 
Compet. 
(13) 


iURE 

I TP A 
(15) 


Academic 

(16) 


Other 

(23) 


Immediate 

55 .57 
St .03 
n 373 


3 

1/1 

O 

5- 

19 

& 


Good 


IS 
.51 


(n) 
(118) 


,54 
(65) 


.61 
(6) 


.42 
(19) 


.22 
(5) 


.67 
(11) 


(3) 


.50 
(9) 


Fair ,57 (125) 


.73 
(39) 






.29 
(17) 


1.07 
(7) 


.89 
(5) 


.35 
(23) 


Poor .62 (130) 


.58 
(58) 


.86 

(10) 


.66 
(18) 




.57 
(18) 


.70 
(6) 


.65 
(10) 


1-12 months 

55 J3 
Se .05 

n 86 


Good 




(16) 


.36 
(8) 




(2) 










Fair .34 (41) 


.31 
(20) 


-.01 

(5) 


(3). 




(3) 


.45 

(8) 


(2) 


Poor .38 (29) 


.29 
(14) 


(2) 




(2) 


(1) 


(3) 




12-24 months 
55 Ji 
Se .05 
n 62 


Good 


.33 


(22) 


.29 

m 










.35 
(13) 


(2) 


Fair .30 (24) 


.31 
(16) 




(i) 




d) 


.22 
(6) 




Poor .31 (16) 


.49 

(6) 




.23 
(9) 







(1) 




24-36 months 

Se .07 
n 24 


$ 
3 

O 

I 


Good 


R 

.27 


(n) 
(15) 


.33 
0) 





(2) 




(4) 




Fair .47 (3) 












(3) 




Poor .21 (6) 


(I) 










.08 
(5) 




36-60 months 

55 -M 
St ,09 
n 38 


Good 


-01 


(13) 


.43 
(5) 




(3) 






09 
(5) 




Fair ..03 (22) 


.02 
(12) 










• .09 

(7) 


(3) 


Poor -.05 (3) 












(3) 




60> months 
55 .^03 
Se .07 
n 49 


Good | | 
















fair ,17 (9) 


th 




(4) 






(2) 


(2) 


Poor .,07 (40) 


-.39 

(18) 




(2) 


(2) 




.05 
(18) 





"•■ means less than 5 ES's present in cell. 
"BtanL M means no ES's present In cell. 
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these results are tentative, they provide valuable information about the 
current state of the art in early, intervention. 

Overall effects of early intervention . The overall conclusion is that 
early Intervention programs do result in moderately large immediate benefits 
for handicapped and disadvantaged populations. These results are evident 
over a wide variety of outcome variables including IQ, motor, language, 
and academic achievement. Unfortunately, there are relatively few results 
for outcomes such as self-concept, social competency, or family and peer 
relationships. In addition, most of the effect sizes for the handicapped 
population refer to mentally retarded, orthopedically impaired, or 
heterogeneous groupings of handicapped children; and most of the mentally 
retarded populations are in the mild to moderate range. Very few effect 
sizes have yet to be included for severely or profoundly handicapped 
populations, sensory impaired children, behaviorally disordered children, or 
speech impaired children. Nonetheless, the data do support the immediate 
benefits of early intervention programs across a wide variety of children, 
conditions, and types of program. 

Degree of structure . As shown earlier in Table 2.11, one of the most 
consistent findings in the data are that more highly structured programs are 
directly associated with more effective outcomes on the order of .3 to .5 
standard deviation units. This information is supported by the fact that 
home intervention programs which use written programs are somewhat better 
than programs without written programs and that wi thin-study comparisons 
between structured and unstructured programs show app» oxlmately half a 
standard deviation difference. This finding is in agreement with much of 
what has been reported 1n previous literature. 
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Involvement of parents . Results from the meta-analysis as to whether 
involving parents in intervention. programs lead to more effective outcomes is 
less clear-cut. Contrary to what many previous reviewers have concluded, 
there is no clear evidence that parental involvement is a key to effective 
early intervention programs. Data from this meta-analysis do suggest that 
parents can be effective intervenors; however, it does not appear that 
parents are essential to intervention success, nor are interventions which 
use parents any more effective than those which do not. 

Data for this conclusion are based largely on the results of studies 
with disadvantaged children. Considering only the data from studies v. i t h 
disadvantaged children, there is essentially no difference between programs 
which were delivered to the child only as opposed to those delivered to the 
child and the parent, no difference on the two variables which assessed the 
degree to which parents were involved in the program, and about a tenth of a 
standard deviation difference favoring center-based programs over home-based 
programs when analyses were limited to good studies on the same measures. 
Within-study comparisons of degree of parental involvement showed .08 of a 
standard deviation difference favoring more parental involvement. Many of 
these results, however, are due to one study (Gordon, 1968). When the Gordon 
study is excluded, programs which do not involve parents or involve parents 
less show an advantage of .06 of a standard deviation over increased parental 
involvement. Taken together, these data question the assumption that 
parental involvement is a key variable in providing effective intervention 
programs for disadvantaged children. 

With handicapped children, the evidence is even less clear-cut because 
not as much data are available. In the initial analyses, programs which have 
extensive or moderate parent involvement have lower average effect sizes than 
programs with no parent involvement. This may be attributable in part to 
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the fact that programs working with more severely handicapped children make 
greater efforts to involve the parents. In addition, these initial 
differences decrease substantially or disappear totally when the comparisons 
are limited to only high quality studies. Again, these data suggest that 
although parents can be effectively involved in intervention programs for 
their children, the involvement of parents is not an essential ingredient nor 
is there any evidence that programs which do involve parents are any more 
successful than programs which do not. 

No within-study comparisons for parental involvement were identified in 
studies of handicapped children. In addition, the types of handicapping 
conditions with which parents might be most effective (behavioral disorders, 
speech impairments) are almost nonexistent in the data set at this point. 
This suggests that the relation between parental involvement and intervention 
effectiveness in programs for the handicapped is a fruitful area for further 
research. 

Another problem with both the disadvantaged and handicapped subgroups 
in interpreting the degree to which parents should be involved in early 
intervention programs is that it is quite possible that what parents have to 
offer most in such programs is what has been measured least. In other words, 
parents may not be any more effective than anyone else 1n developing IQ, 
language, or motor skills, but may be very important 1n the transmission of 
cultural and moral values, the development of self-concept and social 
competency, and the establishment of aspirations and goals. These variables 
have been measured very seldom in the early intervention research 
1 iterature. 

Training of primary intervenor . It appears that primary intervenors who 
are certified are substantially more effective than noncertified intervenors 
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for both handicapped and disadvantaged populations. These differences become 
even greater for handicapped populations when the analyses are limited to 
high quality studies or to similar types of outcome measures. The advantage 
for certified primary Intervenors 1s even more Impressive when one considers 
that certified Intervenors are probably most often the primary Intervenor 
with the more severely handicapped populations. 

With the disadvantaged data set, the Initial advantage for certified 
primary Intervenors largely disappears when only good studies are considered. 
However, when only good studies with similar outcomes (I.e., IQ) are 
considered, there 1s almost a third of a standard deviation difference 
favoring certified Intervenors over not certified Intervenors. That these 
differences are based on reasonably large numbers of effect sizes (50 and 44 
respectively) lends additional credence to the conclusion that certified 
intervenors are more effective than noncertifled intervenors. 

The data from the handicapped and disadvantaged populations reinforce 
the notion that training of intervenors 1s an Important variable contributing 
to the effectiveness of early intervention programs. Unfortunately, no 
wi thin-study comparisons have been Identified at this point; thus 
identifying another fruitful area for further research. 

Age at which intervention begins . Data included thus far in the meta- 
analysis provide little or no support for the popularly held notion of "the 
earlier the better". When data from only the disadvantaged population are 
considered, there is no indication of a linear trend with children who begin 
intervention earlier doing substantially better. When the data are limited 
to only good studies, or to good studies measuring only IQ, the results are 
the same. Looking at wi thin-study comparisons, Gordon found a small positive 
effect of approximately a tenth of a standard deviation favoring, those 
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children who began intervention at earlier ages. Forty-two effect sizes from 
six other studies similarly found- an advantage of about .07 of a standard 
deviation favoring those children who begin earlier. A tentative conclusion 
is that although there is a trend for children who begin earlier to do 
bett.er, the differences are very '.mall and unconvincing. 

When only those studies are considered which included handicapped 
children, the results are less clear-cut. There is some evidence that 
children who start-later do substantially better (see Table 2.14, Panel A). 
However, these results are very likely confounded because more severely 
handicapped children are probably identified and begin programs earlier but 
have a less positive prognosis. Furthermore, the handicapped data set does 
not include data for many types of handicapping conditions and the number of 
effect sizes in each grolip is relatively small. However, there are no data 
yet showing that the earlier programs start, the better children do. Again, 
more research focusing on within-study comparisons of time at which 
intervention starts is needed. 

Maintenance of benefits . At first glance, the data in Table 2.15 
suggest that for disadvantaged populations, the immediate benefits of early 
intervention decline rapidly up to about 36 months after the intervention is 
completed, and are completely washed out after that point. These data are 
more convincing because they are based on fairly large numbers of effect 
size. When data from only the good studies are considered, the trend holds 
up but is based on many fewer effect sizes. If one looks at only the results 
of IQ measures for good studies, benefits of early intervention do not wash 
out completely, but the number of effect sizes is so small that it would be 
unwise to place too much confidence in these results. 
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Do these results demonstrate that early Intervention has no long-term 
effect? Such a conclusion would be unwarranted at this point because of the 
small number of effect sizes and the fact that many of the areas In which 
long-term benefits would be most likely have been very infrequently measured. 
However , the assertion that early intervention has no long-term effect is 
just as adequately supported (perhaps more so) than the frequent assertions 
that long-term benefits for early intervention have been demonstrated beyond 
a shadow of a doubt. The data included in the meta-analysis contain little, 
if any, evidence that long-term effects do exist. Therefore, it 1s important 
that both practitioners and researchers exercise caution in making claims 
about the long-term benefits of early Intervention, and that more research or 
long-term efficacy 1s conducted. 

Con clusions 

Data collected and analyzed thus far in the meta-analysis provide a rich 
source of information for drawing conclusions about the effectiveness of 
early intervention, Including the identification of which factors appear to 
contribute to the most effective intervention programs, and in Identifying 
further research needs. At this point, the meta-analysis data suggest that 
early intervention practitioners and researchers should be much more cautious 
about asserting that intervention programs should be started as early as 
possible, should involve parents as much as possible, and result in long-term 
benefits. There does seem to be substantial support for the Immediate 
benefits of early intervention and the fact that more highly structured 
programs are more effective than programs which are not so structured. 

Data included thus far 1n the meta-analysis underscore the problem noted 
in the analysis of previous reviews of the early intervention literature, 
that many reviewers based their arguments more on emotion than on data. 
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There was a tendency to advocate for the necessity of early intervention 
programs rather than investigate what could be concluded from existing data. 
In other words, many people went out to find results that demonstrated the 
efficacy of early intervention rather than to find if early intervention was 
effective. To the degree that this is true, at least two negative 
consequences resulted. First, by "overpromising" what early intervention was 
able to deliver, the field may soon find itself in the position of not being 
ible to deliver on promises which are impossible to meet. In a time of 
fiscal austerity, such a situation could boomerang on the advocacy efforts 
which were undertaken so strenuously in the 1970s and early 1980s. 

Of more long-term consequence, however, is the fact that by being so 
anxious to prove that early intervention was effective, the field may have 
inhibited the conduct of research which is necessary to determine whether or 
not it is effective; and, if so, what types of programs are most effective. 
Thus far, the results of this meta-analysis have demonstrated that some of 
the most strongly held opinions about early intervention are in fact 
supported by very little data. For example, only nine studies were 
identified which compare different degrees of parental involvement, the 
overall results do not support the advantage of parental involvement, and 
none of these studies were done With handicapped children. Yet, the notion 
that parental involvement is essential for success in early intervention 
programs for handicapped children is pervasive. Additionally, only seven 
studies were identified which compared the effects of beginning intervention 
programs at different ages, and these studies provided very little support 
for the notion that programs which start earlier are more effective. 
Nonetheless, everyone seems to "know" that programs which start earlier are 
more effective. The "knowledge" of facts such as those cited above has been 
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disseminated broadly and used extensively in advocacy efforts and may, in 
fact, have inhibited the types of research that are most important to 
conduct. In other words, researchers did not propose and agencies did not 
fund studies to investigate the immediate and long-term effects of variables 
such as degree of parental involvement, or age at which intervention begins, 
because it was assumed these questions had already been completely resolved. 

Although a number of tentative conclusions are supported by the data 
thus far collected, in most instances, the results of this meta-analysis do 
not provide definitive evidence for or against the efficacy of early 
intervention or various types of intervention. Important findings from the 
data are to identify areas where more research is needed. By pointing out 
exactly what kind of evidence is available for answering various pressing 
questions on the efficacy of early intervention, it is hoped that other 
researchers will use this to plan and conduct additional research. In 
addition, the number of analyses which are possible with "this data set are 
voluminous. It is hoped that researchers will utilize the data made 
available in this meta-analysis to examine alternative hypotheses and 
potentially confounding variables for the tentative conclusions which have 
been presented. Finally, it is hoped that one of the strongest results of 
this meta-analysis will be that practitioners, researchers, and 
administrators will be more cautious in declaring what is "known" to be 
effective in the area of early intervention, so that future research will be 
encouraged. 
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CHAPTER III 

COST-EFFECTIVENESS ANALYSIS OF EARLY INTERVENTION PROGRAMS 

In the September, 1982 proposal, the Early Intervention Research 
Institute proposed two major goals in the area of cost-effectiveness (CE) 
analysis of early intervention: 

1. To develop a model for using cost-effectiveness analysis techniques 
with early intervention programs. 

2. To apply the cost-effectiveness model in the comparison of early 
intervention programs. 

The procedures used to create and use the model will be described below in 
two sections: The Cost-Effectiveness Protocol and A Cost-Effectiveness Study 
Comparing Half- and Full-Day Early Intervention Programs . 

The Cost-Effectiveness Protoc ol 

The production of the cost-effectiveness protocol by EIRI follows the 
steps typically used in model development and Research and Development: 

1. Review the state of the art. 

2. Plan scope and content. 

3. Develop preliminary form. 

4. Conduct preliminary field test. 

5. Revise product. 

6. Conduct main field test. 

7. Receive expert review and revision. 

8. Conduct operational field test. 

9. Revise final product. 

10. Disseminate and distribute. 

To date, EIRI has complet.-.d the first six steps, through the main field 
test, for collecting, analyzing, and summarizing cost data. The details of 
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steps 1-5 are provided below and step 6 1s described In the second section of 
this chapter as A Cost-Effectiveness Study of Half- Versus Full-Day Programs . 
During the next funding cycle (October 1, 1983 through September 30, 1984), 
EIRI will concentrate on collecting and analyzing effectiveness data and will 
solicit expert feedback, conduct the operational field test, and produce a 
cost-effectiveness manual for distribution. 

Specific procedures used to complete the first five steps with cost data 
are detailed below. 
1. Review the State of the Art 

A computer search was conducted to locate research on cost- 
effectiveness in early intervention. Although the literature was replete 
with statements describing programs as "cost-effective" for early 
intervention, no-study was found to report results of a cost- 
effectiveness analysis actually conducted. Similarly, research from 
related areas (health and social services) showed few actual cost- 
effectiveness comparisons. 

With few models or samples to lead the way, EIRI generally 
formulated techniques for conducting cost-effectiveness from theoretical 
discussions of what should be undertaken. Specific cost-analysis 
procedures were adopted from cost-accounting and the economic literature 
on social welfare. Specific procedures for determining a comprehensive 
measure ot program effectiveness were not developed this past year 
because the outcome measures available to EIRI were dependent on what 
field test sites chose to. use. EIRI expects to investigate the area of 
program effectiveness in detail in future years and develop the 
effectiveness protocol simultaneously. 
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The ingredients approach developed by Henry Levin (an Advisory 
Committee member) was chosen as the preferred method to Identify and 
collect cost data. Under the ingredients method, all resources used by 
the program are identified. These resources include services and 
materials purchased by the programs being analyzed as well as services 
and materials used without direct purchase (e.g., parent intervention 
time, federally supported lunch, volunteer aide time). A preliminary 
list of ingredients was drafted from the literature and used as an 
outline in preparing the cost analysis section of the protocol. 

Five guidelines for cost-effectiveness analysis were established 
following a review of economic principles and were incorporated 
throughout the cost analysis sections of the protocol. 

1, Cost-effectiveness analysis 1s a comparative procedure that shows 
the relationship of costs to effectiveness across two or more 
alternative choices. A program cannot be deemed "cost-effective" 
through analysis but can be shown in relative terms to be more or 
less cost-effective than another program. 

2. Cost-effectiveness analysis is a tool for decision makers who desire 
information to assist them in making educated choices. The analyti- 
cal process of collecting, analyzing, and summarizing data is time 
consuming and expensive. Consequently, the analysis should be 
reserved for those situations where real choices are to be made and 
resulting data will have a bearing on final decisions. The findings 
from a cost-effectiveness analysis should not be viewed as the final 
step with a path of action clearly marked, but as one set of 
extremely useful data to use in conjunction with other data sets to 
provide the best system for serving children given a unique set of 
circumstances. 
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The questions to be answered by decision makers regarding the best 
program should structure- the format of the cost-effectiveness 
analysis. Careful and considerate attention must be given to the 
formulating of the question to be answered. The question must 
reflect true alternative choices that are reasonable and plausible. 
If a choice between alternatives involves comparing the use of 
professional versus paraprofesslonal speech therapy aides, then both 
alternatives must be feasible. Because the choice involves an 
examination of only one component of the program, the analysis need 
only be concerned with costs and effectiveness directly related to 
speech therapy. 

All resources associated with program aspects under consideration 
must be identified and valued as a private or social cost. To 
exclude some resources, such as volunteer time, because they are not 
purchased directly, will misrepresent the resources needed to 
replicate the program. Without the volunteers, for example, the 
program would be different— possibly, the outcome would be 
different. So while listing program requirements, resources for 
all components must be identified and valued in dollars. 
The measure of effectiveness must be comprehensive and provide an 
estimation of program impact on those facets of life which society 
(consumers) believe important To compare costs and effectiveness, 
it is crucial that both sides be as complete as possible in 
representing what the program did. A CE ratio showing total costs 
by only IQ gain would inflate the price of the program and 
misrepresent the effect. Unfortunately, we as a society have not 
determined what we value as the benefits of early intervention and 
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until we do, the comprehensive measurement of program effectiveness 
is impossible. EI RI is committed to striving for research in this 
area as cost-effectiveness procedures become more refined. 

2. Plan Scope and Content 

The Cost-effectiveness Protocol was organized into four sections: 
Description of Cost-Effectiveness Analysis, Cost Analysis, Effectiveness 
Analysis, and Cost-Effectiveness Summary. For the first year, EIRI 
focused on the development of the cost analysis section of the protocol 
and this section is included in a separate document titled "Cost- 
Analysis". Cost analysis is further divided into three subsections 
labeled "Cost Data Collection", "Cost Data Analysis", and "Cost Data 
Summary". The "Cost Data Collection" subsection has been included in 
this report in Appendix 3-F. 

Cost data to be collected were organized into three categories: 
personnel, nonpersonnel (facilities, equipment, transportation) and 
contributed resources (parent, government, volunteer, donations). The 
procedures for collecting and analyzing data were developed based on 
using the child as the unit of analysis. That is, all cost data were 
disaggregated by the children using the service being valued. Decisions 
on how to disaggregate costs across children were made based on accepted 
accounting procedures. Some costs were prorated based on percent of time 
used and others were divided across the board because time use was not 
available (e.g., administrator's time). 

3. Develop Preliminary Form , 

Cost data collection forms were developed to be used on site to 
collect descriptions of each program component. These forms are located 
in Appendix 3-F. Typically, cost data were collected on site and 

i 
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Included an extensive program description plus child and staff 
demographics and specifics regarding the resources required for the 
operation of each component of the project. For ease in data collecting 
at the site, data were organized in nine categories: Personnel Expenses, 
Personnel Time, Child Demographics, Child Transportation, Facilities, 
Equipment, Supplies, Travel, and Contributions. 

The major considerations in form development were that the forms had 
to prompt the data collectors as to what to collect and had to organize 
data in a manner that would lead to data analysis. For example, to 
accurately describe the program, demographic data on children and staff 
were needed, so a form was developed with spaces for filling all relevant 
bits of information. To value the transportation costs for each child, 
specific information was required about the vehicle, gas, insurance, 
number of children other than preschool who used the vehicle, and miles 
per day. 

Cost data analysis forms were developed to reorganize the data from 
the collection phase. During data analysis, cost data were disaggregated 
across each child in the program. Each cost was handled separately and, 
depending on the program, could result in a breakdown of dollars, time, 
or counts of more than 50 variables. By dividing costs using the child 
as the unit of analysis, a record of costs for specific individual costs 
could be obtained. For example, the cost of classroom space and therapy 
room space for child ID #11042 could be identified. Although several 
sets of forms were produced by EIRI to assist in disaggregating costs, 
the system tends to vary' substantial ly across programs and a final, 
generic protocol has not been finalized at this time. 
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The next stage in cost data protocol development is to summarize the 
cost data into a meaningful format that answers questions which 
originally stimulated the research, that examines sources of covariation 
among variables to explain relationships, and that can be displayed with 
effectiveness data to provide an estimation of overall net worth. 
Because all data are analyzed at the individual child level, final 
summaries can be provided by aggregated data by several subgroupings. 
For instance, the average total costs for speech impaired children can be 
identified. Costs for facilities can be shown for home-based and center- 
based children. Travel costs for therapists and average number of 
therapy hours per child can be shown for rural and urban programs. 
Essentially, cost data summaries are limited only by the questions that 
decision makers chose to ask. 

4. Conduct Preliminary Field Test 

Two sites in Wyoming were selected for the preliminary field test of 
the cost data protocol. The comparison of alternatives was not possible 
at the two sites because of research design problems (random or matched 
sampling not available) and because of the lack of feasible alternatives 
of choice. Therefore, effectiveness data were not collected, nor were 
cost-effectiveness ratios computed and compared. The major objective of 
the preliminary field test was to determine if cost data could be 
collected, analyzed, and summarized using procedures established in steps 
1-3. 

5. Revise Product 

The preliminary field test proved successful and cost data were 
easily handled within procedures developed. Basically, revisions in 
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forms were made to expedite the collection of data on site and to more 
easily handle the disaggregation during analysis. 
6. Conduct Main Field Test 

This test was conducted in Sioux City, Iowa, where a research 
question had been formulated, "What is the relative cost effectiveness of 
half- versus full -day intervention?" This question permitted both costs 
and effectiveness data to be analyzed and compared and the findings are 
explained in detail in the next section. 
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A Cost Effectiveness Analysis C omparing Ha If- 1 and Full- 
na y Intervention Programs 

Although hundreds of studies have been conducted on various aspects o.; 
early intervention for preschool children, there is much disagreement as t. 
the relative worth of various types of early intervention services. An ac; 
rate determination of the relative worth of programs requires that both In- 
effectiveness (or outcomes) and costs of alternatives be analyzed simulta- 
neously. For example, the most effective program may be prohibitively 
expensive and, as a result, may not be the most cost effective. Conversel 
an ineffective program which is relatively inexpensive also is not cost 
effective . As the availability of money for educational programs becomes 
more restricted, administrators, providers, and consumers are becoming nor 
concerned about which of various program alternatives are the most cost 
effective . Such decisions require that comparative cost and outcome data 

analyzed simultaneously. 

Appropriately conducted, a "cost-effectiveness" (CE) analysis requir 
the comparison of alternatives. To conclude that a single project or 
approach is "cost effective" ignores the critical question of \ . . as c 
pared to what?" A recently conducted review of literature which claimed 
investigate the "cost effectiveness" of early intervention programs show 
that most studies suffered from inappropriate or incomplete analyses of 
the costs and the effects. The most frequently identified problems 
included: 

1. Important cost data (e.g., contributed and shared resources) we 
omitted from analyses; resource expenditures were derived using only bud 
figures. 

2. The cost differentials of serving subgroups of children (e.g., 
orthopedically versus mentally disabled, rural versus urban) were ignore 
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3. Costs and effectiveness were never examined simultaneously within 
the same study. 

The methodological inadequacies of previous efforts to examine the cost 
effectiveness of early Intervention program alternatives have left decision 
makers with very little empirical evidence on which to base decisions. A 
common concern facing preschool service administrators is how to reduce or 
hold down costs while maintaining or increasing the level of benefits. 

One technique which some have suggested to reduce costs is the use of 
half-day programs rather than full-day programs. However, to examine only 
the costs and not the benefits of programs will provide only half of the 
information needed for decision making. The first question to answer in 
comparing half-and full-day programs should be, "Are half-day programs as 
cost effective as full -day programs?" In other words, if half-day programs 
cost 30% less but result in only one-half as much gain, it would be foolish 
from a "cost-effectiveness" perspective to switch to half -day programs. An 
alternative which is truly more cost effective would result in the same or 
greater gain for less money— i.e., more gain per dollar spent. The second 
and even more intriguing question is, "Are half-day programs more cost 
effective with some types of children and full -day programs more cost 
effective with others?" 

The study described below analyzed the costs and effectiveness 
of half- versus full-day programs for children with communication and mental 
handicaps. To avoid the deficiencies found in previous cost analyses of 
early intervention programs, a cost-effectiveness model was developed within 
an economic framework. The accuracy of the model depends on the collection 
of a comprehensive data base describing the costs and procedures of all pro- 
gram components. Program budgets cannot be used as the only source of data 
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because budgets usually do not accurately reflect the total costs of a 
program. For instance, the value of contributed resources (e.g., regional 
services, equipment) are not typically listed as expenses even though they 
represent expended resources. To overcome the problems with using only 
budget figures in cost-effectiveness (CE) analysis, this study has defined 
and measured ajj_ of the costs (resources) needed to implement each of the two 
delivery strategies. 

An important characteristic of this cost-effectiveness model is that 
because cost data are partitioned separately for each child, costs can be 
analyzed using a variety of breakdowns. Most of what is described in this 
report partitioned costs and effectiveness data separately for 
communicatively disabled (CD) and mentally disabled (MD) children. Other 
subgroupings (e.g., age at entry, mildly handicapped versus moderately 
handicapped, duration of treatment) could be analyzed easily because all data 
were collected using the child as the unit of analysis. 

Objectives 

The purpose of this study was to conduct a cost-effectiveness analysis 
of using half- and full -day programs to provide services to preschool 
handicapped children. Specific objectives were: 

1. To determine the cost and effectiveness differentials of using half - 
and full-day programs. 

2. To determine the cost and effectiveness differentials of serving 
communicatively and mentally disabled children. 
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Methods 

This study was conducted in cooperation with school districts in Area 
Education Agency #12, Sioux City, Iowa. Seven half-day classrooms were 
located in the Sioux City school district, and eight classrooms using the 
full-day program were located in school districts surrounding Sioux City. 
Provided below is a detailed description of the research sample, school 
program, research design, dependent variables, and data collection. 

Research Sample 

To compare full- and half-day programs, a matched sample was selected 
for both communicatively disabled (CD; N = 11 pairs) and mentally disabled 
(MD; N = 15 pairs) children in the classrooms referred to above. The number 
of males in the sample were 5 (CD, half), 7 (CD, full), 9 (MD, half), and 10 
(MD, full). Children in half- and full-day programs were matched based on 
months of previous treatment in home- and center-based programs, age, and 
developmental months from the Minnesota Child Development Inventory (MCDI) at 
the time they entered treatment (see Table 3.1 for mean scores). 

The MCDI was developed in 1972 as an instrument for identifying children 
from 6 to 78 months who are developmental^ delayed. To administer the 
instrument, an interviewer asks the child's mother to report which of 320 
behaviors she has observed the child exhibited. Scores are reported for each 
of the eight developmental areas listed in Table 3.1, The mean internal 
consistency of the MCDI scales was established at .79 using the split-half 
method. Using mental ages derived from the administration of the Stanford- 
Binet, Bayley, and Cattell tests, a correlation of .92 with the MCDI General 
Developmental Scale was found. While attempts at establishing validity have 
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Table 3.1 

Mean Scores on Matching Variables 
(Standard Deviation) 



Variable 


CD 


MD 


Half 

nail 


Full 
run 


Half 


Fill 1 
r u i i 


Age 


57.6 


54.5 


60.8 


62.6 




(9.0) 


(8.9) 


(7.8) 


(9.5) 


Months in home program 


.5 


1.1 


1.7 


.93 




(1.8) 


(2.5) 


(3.8) 


(2.7) 


Months in center program 


12.8 


13.5 


14.8 


14.5 




(6.3) 


(6.2) 


(6.7) 


(7.8) 


Chronological months at 


37.2 


34.0 


36.5 


37.8 


testing data 


(7.0) 


(11.6) 


(5.5) 


(8.7) 


MCDI scores (developmental months) 










Honor a 1 Ho uo 1 nnmo n t 


21.9 


21.5 


20.6 


22.2 




(7.3) 


(8.0) 


(4.3) 


(6.6) 


v' Ui j IIIU UU r 


26.4 


26.5 


28.6 


28.3 

Cm • <J 




(8.4) 


(13.0) 


(12.2) 


.(12.6) 


Pino mn^nv* 


29.3 


27.4 


23.3 


25.6 




(9.6) 


(12.5) 


(5.2) 


(8.4) 


Expressive language 


19.2 


18.5 


19.4 


20.3 




(7.3) 


(6.6) 


(4.4) 


(5.6) 


Comprehension/conceptual 


20.8 


21.2 


20.1 


21.8 




(6.5) 


(7.4) 


(3.9) 


(5.8) 


Situation comprehension 


28.2 


28.1 


26.1 


27.1 




(10.1) 


(12.8) 


(8.2) 


(10.0) 


Self-help 


31.0 


31.1 


30.2 


31.8 




(9.3 


(14.0) 


(8.9) 


(11.4) 


Personal/social 


28.1 


23,7 


22.1 


27.6 




(12.6) 


(8.2) 


(7.0) 


(9.8) 



been undertaken, adequate work has not been completed. Although there may be 
some problems in using the MCDI to distinguish between delayed and nondelayed 
low SES children, research has shown that 69% to 86% of children tested were 
correctly classified using teacher's observation as a standard. 
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Individual child data on each matching variable are presented In Appendix 
A. There were no statistically significant differences between half- and 
full -day children on any of the matching variables. 

School Program for Half- and Full-Day Classrooms 

Information describing the half- and full-day programs is presented in 
Table 3.2. Details a»e explained in the sections below. 

Table 3.2 



Descriptive Means for Half- and Full-Day Classrooms 



Variable 


Half 


Full 


Length of children's school day (hours) 


3.25 


6.5 


Children per class 


6.68 


7.28 


Hours per child per year 


19.04 


14.60 


- Speech therapy 


- Physical/occupational therapy 


8.40 


6.36 


- AEA consultant 


7.46 


6.68 


- Parent Involvement 


76.28 


98.49 


- Music, art, PE 






Children per adult 


3.34 


3.64 


Miles - home to center 


5.39 


6.62 


Number of aides per class 


1.00 


1.10 


Number of volunteers per class 


0 


.43 


Salary + Benefits 


18,703.00 




- Teacher 


16,344.00 


- Aide 


5,601.00 


5,514.00 


Cost of contact hour/ Hour of instruction 


3.04 


2.04 


Classroom sq. feet 


750 


625 


Value of classroom 


4,598.00 


4045.00 


Teacher 






- years experience 


6.9 


4.9 


- Decree 


4-MA, 1-BS 


1-MA, 6-BS 


Budget cosf per hour of Instruction 
- Personnel cost/hour of instruction 


8.65 


4.90 


- Nonpersnnnp.l r.nst/hnur ,of instruction 


l.fi.1 


,98 



Half-day program . Teachers in the half-day programs taught two classes 
a day, one in the morning and one in the afternoon. A typical half-day 
consisted of approximately three and one-half hours in which children were 
taught developmental skills in individual and group sessions. Children 
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received therapy during class time in separate rooms. Once a week, children 
received approximately 15 minutes each of art, music, and PE. Most of the 
teachers visited the home of each child two to four times a month to talk to 
the parents about their children's progress and suggest developmental 
activities for the child the parents could conduct in the home. 

Full -day programs . All teachers in the full-day program taught the 
entire day (approximately 7 3/4 hours). The curriculum was similar to the 
one used in half-day programs, except that art, music, and PE were not 
provided by teachers outside the classroom. Children received therapy either 
in their classrooms or in another room. Teachers typically visited the home 
three to four times a month to work with the parents. Most children lived in 
the same school district where they attended class, but a few were bused from 
other districts. 

Research Design 

Both effectiveness and cost data were analyzed using a 2 X 2 comparison 
for CD and MD children across half- and full -day programs: 



Half 
Full 



Table 3.3 
Research Design 



CD 


MD 


N = 11 


N = 15 


N * 11 


N = 15 



Dependent Variables 

Effectiveness . To measure the effectiveness of the full- and half-day 
programs, scores from the Early Childhood Continuum of Assessment, 
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Programming, Evaluation, and Resources (CAPEK) were analyzed. The CAPER is a 
locally developed developmental inventory designed specifically for use with 
preschool handicapped children. A continuum of 1,102 objectives can be 
tested on children aged 0-72 months, in each of five strands: motor, 
language, social, self-help, cognitive. Correlations computed between the 
CAPER and the Stanford-Binet we*e .91 on cognitive and between Preschool 
Language Scale and CAPER were .86 on expressive language. 

Since some CAPER subtest scores were not collected for all children, 
only those subtests with the most complete data were used in the analyses: 
expressive language and cognitive subtests. Outcome data were analyzed.using 

the score derived by computing g^gf, ffi for each child. 

Costs . Three categories of cost data were collected: Personnel costs 
(salary and benefits), Nonpersonnel costs (equipment, facilities, and 
transportation), and Contributed resources (parent time and materials, 
consultants, and volunteer time). Cost data for one year were disaggregated 
across all children enrolled in half- and full-day programs (see Data 
Collection). Then costs associated with only those children in the research 
sample were used in the analysis. 

Data Collection 

Outcome data were collected by the classroom teacher, who administered 
the CAPER in May or June, 1983. The CAPER was administered to all children 
in each class. The cognitive subtest was given to all children, then other 
subtests were administered to only those children with perceived deficiencies 
in the areas covered by the subtest. 

In general, cost data were collected from three sources. First, all 
teachers were interviewed individually and asked to describe their schedule 
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for a typical week. The week's schedule contained information by 15-minute 
intervals on teacher activity and individual child activities. Similar 
schedules were prepared for therapists and aides. 

Second, school district staff were interviewed by ph^ne or in person to 
obtain costs for personnel, equipment, facilities, and transportation. 
Third, school records were reviewed to collect demographic information. 
Appendix 3-D contains a detailed description of the data collection process. 

Cost data were collected and categorized in the following format: 

(a) child descriptive information, (b) costs of personnel time for direct 
contact with children, (c) noncontact personnel costs, (d) nonpersonnel , and 
(e) costs of cortributed goods and services. The compilation of these data 
for analysis involved both the reporting of information as it was received 
(e.g., descriptive information) and the disaggregation of time and costs, on 
•a per child basis, from the information collected. The following will be an 
account of the procedures involved in ascertaining these amounts. 

De scriptive information . The following information was collected 
directly from the AEA records of each child: (a) age, (b) gender, 
(c) handicap, (d) months spent in home-based program, (e) months spent in 
center-based program, and (f) type of preschool program (half-day or full- 
day). From the information provided by each preschool teacher, other 
identification data were collected: (a) hours per week spent in the center, 

(b) distance traveled by each child to and from the center, (c) type of 
therapy (speech, physical, and/or occupational) in which the child was 
involved, (d) number of hours of in-home instruction the teachers provided, 
(e) an estimate of parent involvement in prescribed therapeutic intervention, 
and (f) the mode of transportation utilized by the child in traveling to and 
from the preschool. This information was received and entered directly as 
identifying data for each child. 
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Direct contact . All costs for direct contact were computed as a 
proportion of salaries. Salaries shall be defined in this report as wages 
plus benefits. Direct contact costs were always applied specifically from a 
particular service provider to the child receiving the contact. Personnel 
supplying direct contact time were classroom teachers, aides, therapists, bus 
drivers, cafeteria personnel, and other teachers for recess, music, art, and 
PE. Direct contact time is defined as hours spent in contact with the 
children for instruction, therapy, recess, lunch, nap, or riding a bus. Each 
person who directly contacted a child was asked to compile a typical weekly 
schedule that indicated the activity, time period, and children involved. 
Each shared time block was divided by those children in the group receiving 
service. For example, each child in a group of three for 15 minutes, 
received 5 minutes of instruction but used only 5 'minutes of the teachers 
salary. In this manner, the teacher's salary was then prorated among the 
children based on proportion of time used by the child. 

Personnel involved include all that provided direct contact, principals, 
secretaries, AEA personnel , custodians, and consultants. 

Noncontact personnel costs . All personnel associated with preschool 
handicapped reported on their time spent in activities other than direct 
contact. Data were collected for a typical week, as with contact time, then 
applied throughout the year as appropriate. Activities conducted outside the 
regular schedule were also reported and a proportion of salary was allocated 
based on time spent. Personnel were asked to report their time in the 
following categories. 

Preparation refers to activities that support "Direct Intervention", for 
example, preparation of materials, working up lesson plans, organizing room, 
preparing food, daily record keeping, daily clean-up, and writing child 
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specific reports. Also included are "staffings" (meetings with several staff 
for the purpose of planning curriculum for a specific child). Costs for 
preparation time were computed by individual child using the same proportions 
calculated for direct contact and applying that proportion to the salary 
costs. 

Travel refers to travel for home visits and for center-related 
activities that occur on a weekly basis and pertain to particular children. 
Travel from home to work is not included. All travel time costs are assigned 
directly to the child for which travel is undertaken. When several children 
are to benefit from travel, costs are divided among them. 

Parent contact refers to regularly scheduled parent training and IEP 
meetings, excluding visits in conjunction with home program, also short 
unscheduled meetings which occur frequently throughout the year. Salary 
costs for parent contact time were always assigned directly to the individual 
chi Id, 

CAPER refers to the salary costs associated with testing children with 
the CAPER, The test was given to all children every nine weeks during the 
school year. 

Consultant refers to the salary costs of providing technical assistance 
to classroom teachers and aides. Salaries were divided first among 
classrooms based on the proportion of time spent by the consultant in the 
classroom. Then classroom consultant costs were divided evenly among all 
children enrolled in the room. 

Special Education administration refers to costs for administrative time 
needed to run the half-day program. Because all half-day classrooms are 
located in one building, a half-time supervisor and full-time secretary are 
used in addition to the K-12 principal found in both the half- and full-day 
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programs. Salaries for special education administration were divided equally 
across all half-day students. 

Principal/secretary - administration - salary costs for the building 
principal and secretary were divided across all children enrolled at the 
facility (preschool through grade 12). 

AEA - administration - Iowa has divided the administration of its school 
system into 15 Area Educational Agencies (AEA). The AEA preschool 
handicapped program then services the school districts 1n Its area. Data 
were collected that described the administration time devoted by the 
preschool supervisor, PT/OT supervisor, and speech supervisor to the 
preschool program. The salary cost for this time was divided evenly among 
all children in both half- and full -day programs. 

Other - personnel engaged in* several other activities during the year, 
where the salary cost for time was applied to children in the program. Costs 
for screening, evaluation, inservice, and custodial were applied across all 
children who were served by the personnel generating the costs. 

Contributions . This category involved the collection and computation of 
cost per child data of resources necessary in providing preschool interven- 
tion. Specifically, this includes the cost of the home space used in the 
delivery of home intervention by staff and parent, cost of transporting child 
to and from center by the parent (for both time and vehicle operation, 
23i/mi le) , the cost of contributed time by- parents and student aide volun- 
teers in implementing prescribed program intervention, and the cost of food 
for lunch and snacks provided either by the parent or federal government 
subsidy. 

The cost of home space was calculated from the number of hours the home 
was used for intervention and the square feet of space used, and the cost per 
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square foot. Square foot costs were determined by estimations made by local 
real estate agents when asked to provide a rental value. 

The cost of parent and volunteer time was computed at $4.97 per hour. 
This represents the wages plus benefits needed to hire a paraprofessional to 
do the same job. 

Nonpersonnel. Nonpersonnel costs include transportation, equipment, and 
facilities. 

Transportation included the costs for transporting children and for 
reimbursing automobile expenses for consultants, therapists who traveled to 
schools, and teachers who traveled to homes. Travel reimbursement for 
therapists, consultants, and teachers was based upon $. 23/mi . The cost of 
operating the school bus per mile was determined by contacting a local bus 
company contracted for those services ( $. 06/mi /chi Id ) . The number of round 
trip miles for each child was multiplied by that cost for each of the 
children. 

An inventory of classroom equipment and costs for each classroom was 
provided by either the teacher or principal/administrator. Where the cost 
was not provided, the depreciated value of classroom equipment was 
ascertained by contacting local merchants of that equipment. Salvage value 
was used for items that were depreciated completely. The cost for 
individual items in each classroom was then totalled and distributed evenly 
over the number of children using the classroom. 

Cost of each facility was either provided by the administrator (cost to 
rent/year) or determined by contacting local real estate appraisers who 
could provide an estimate of yearly rental cost for each facility. Informa- 
tion regarding the proportion of the entire facility utilized by the partic- 
ular class under study was provided by the individual teacher. That 
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proportion of square footage was multiplied by the previously obtained 
cost/sq. ft. of the facility. That sanie proportion was utilized in 
determining cost of insurance and maintenance, figures which were provided by 
the administrator. The proportional cost of facility, Insurance, and 
maintenance was totalled and that cost was divided evenly over each child in 
that particular classroom, 

, Results 

The results of this study will be presented in three sections: Ei "ec- 
ti veness , Costs , and Considering Costs and Effectiveness Together . (Appen- 
dix 3-E contains a complete accounting of each cost variable, including means 
and standard deviations, by half- and full-day breakdowns for CD and MD chil- 
dren.) 

Effectiveness 

To determine the effectiveness of the half- versus full-day programs, 
CAPER scores collected at the end of the 82-83 school year were analyzed. 
Individual test scores and the date of CAPER administration are reported in Ap 
pendix 3-B. Two CAPER subtests (expressive language and cognitive) were used 
to analyze the differences between half- and full-day programs. In analyzing 
the test results, both children in each matched pair were eliminated from 
analysis if at least one child had missing data. The final analysis of 
expressive language was conducted on the scores from 11 matched pairs of CD 
and 11 matched pairs of MD children fcr the half- and full-day programs. For 
the cognitive scores, 10 CD pairs and 15 MD pairs were included in the 
analysis. 
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The mean and standard deviation for the two tests by handicap and by pro- 
gram are given in Table 3.4. The results show that overall, CD children 
made higher scores than MD children on both expressive language and cognitive 
subtests. An examination of data by half- and full-day shows that CD 
children in full -day programs. scored higher on both subtests than CD children 
in half-day programs. However, MD children in half-day programs scored 
slightly higher on both subtests than MD children in full-day programs. 
There were no statistically significant differences between half- and full- 
day programs for either CD or MD children (CD expressive, t - 1.56; CD 
cognitive, t = .98; MD expressive, t = .15; MD cognitive, t = .51). 



Table 3.4 

Mean End of Year CAPER Scores 
(Standard Deviation) 



Subject 


CD 


MD 


Half 


Full 


Half 


Full 


Expressive language 


77.09 
(13.72) 
N-ll 


87.91 
(21.94) 

N«ll 


73.18 
(19.27) 
N-ll 


71.91 
(16.43) 
N-ll 


Cognitive 


95.9 
(7.31) 
N*10 


99.20 
(9.69) 
N=10 


81.53 
(13.21) 
N-15 


78.33 
(15.33) 
N-15 



Table 3.5 shows the differences between half- and full-day programs in 
standard deviation (SD) units. Comparing the test results of all of the 
children in the full-day program with all of the children in the half-day 
program, there appears to be some, but not dramatic, benefit from the extra 
time provided by full-day programs, especially in expressive language test 
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scores (full-day scores are higher by .21 standard deviation units— this is 
comparable to an IQ gain of about 3 points). However, when the scores ar* 
examined separately for CD and MD children, the pattern 1s strikingly differ- 
ent. In expressive language, full-day CD children are .58 SD units above CD 
children in the half-day program and .39 SD units on the cognitive subtest. 
The results for MD children are just the opposite. Cognitive scores for MD 
children were lower in the full-day program (-.23 SD) than in the half-day 
program. If the analysis were to end at this point, it would seem that 
full -day programs are better for CD children, but half -day programs are 
better for MD children. However, less than half the story has been told. 
Much more will be learned by considering the cost data in conjunction with 
the effectiveness data. 



Table 3.5 

Differences in CAPER Scores in 
Pooled Standard Deviation Units 



Subtest 


CD 

Full vs. half 


MD 

Full vs. half 


Overal 1 
Full vs. half 


Expressive language 


+.58 


-.07 


+.21 


Cognitive 


+.39 


-.23 


+.03 



Costs 

The costs for both half- and full -day programs are shown for CD and MD 
children in Table 3.6. In this table, as with all cost tables, data are 
presented by mean per child costs. Budgeted Costs have been subdivided by 
personnel and nonpersonnel . TOTAL is the sum of Budgeted Costs and 
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Contributions. (Appendix 3-C contains individual child data with the means and 
standard deviation for several computed variables.) 

Intuitively, one would expect full-day programs to be more expensive 
than half-day programs, and the TOTAL shows this to be true for both CD and 
MD children. However, the cost differentials vary considerably by handicap; 
full-day TOTALS are only 12% higher than half-day for CD children but 31% 
higher for MD children. 

The breakdowns of Budgeted Costs and Contributions in Table 3.6 provide 
some other interesting and unexpected comparisons. Budgeted Costs are 
defined as those expenses which are paid out of pocket and represent a real 

Table 3.6 

Mean Costs Per Child Per Year 
(Standard Deviation) 



Variable 


CD ' MD 


Half 


Full 


Half 


Full 


Personnel costs 


6158.73 
(729.98) 


5959.36 
(949.60) 


5208.20 
(856.06) 


6855.40 
(1283,38) 


Nonpersonnel costs 


1393.73 
(262.23) 


1408.09 
(564.87) 


1167.93 
(96.25) 


1446.07 
(518.00) 


Total Budgeted Costs 


7552.45 
(965.61) 


.7367.45 
(1225.92) 


• 

6376.13 
(920.08) 


8034.47 
(1476.11) 


Contributions 


380.27 
(192.97) 


1481.00 
(2139.38) 


376.00 
(365.23) 


781.87 
(459.95) 


TOTAL 


7932.73 
(839.95) 


8848.45 
(2478.10) 


6752.13 
(986.42) 


8816.33 
(1453.68) 
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flow of cash. Contributions represent the dollar value of services and items 
which have been donated (not paid for by program). Comparing Budgeted costs 
and Contributions for just CD children, one can see that Budgeted costs are 
slightly higher for half-day programs but contributions are considerably 
higher for full -day programs. For MD children, both Budgeted costs and 
Contribution are higher in full-day programs. 

An examination of Personnel Costs shows that for CD children, full -day 
costs are 3% lower than half-day, in the opposite direction of expectations. 
Whereas full -day costs for MD children are more in line at 32% higher than 
half-day. Although nonpersonnel costs are in the expected direction, 
differentials for CD children (1% higher for full-day) are very slight and 
for MD children more reasonable (24% hiyher for full-day). The reasons for 
these differences are explored in detail below. 

Results of analyses of variance conducted across half- and full-day 
programs are presented in Table 3.7. Intuitively, one would expect 
statistically significant differences to occur with highest costs associated 
with full -day programs. As expected, with MD children all differences are 



Table 3.7 

F Tables for Total Costs Across 
Half - 'and Full -Day Programs 



ERIC 



Variable 


CD : 

MS F £ 


MD 

MS F £ 


Personnel costs 


218,602 


.305 


.587 


14,287,140 


12.006 


.002 


Nonpersonnel costs 


1,134 


.006 


.940 


580,186 


4.180 


.05 


Budgeted costs 


188,237 


.150 


.703 


20,625,520 


13.635 


.001 


Contributions 


6,663,803 


2.888 


.105 


1,235,458 


7.163 


.012 


Total 


4,612,060 


1.347 


.259 


31,956,912 


20.71 


.000 
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statistically significant at the .05 level, with full-day programs having the 
highest costs. For CD children, however, no statistically significant 
differences were found. 

Educational significance is typically demonstrated when programs differ 
by .s 3tandard deviation units. Table 3.8 shows that overall and for MD 
children mustcosts are educationally significantly .different, reflecting the 
higher costs for the longer school day in full-day programs. For CD chil- 
dren, Budgeted cost differentials were not educationally significant, 
although half-day personnel costs came very close to being significantly 
higher (.24) than full-day. Full-day CD children did receive significantly 
more contributed resources than half-day. 

Table 3.8 

Differences in Costs Between Half- and Full-Day 
in Pooled Standard Deviation Units 



Variable 


CD 

Full vs. Half 


MD 

Full vs. Half 


Overall 
Full vs. Half 


Personnel costs 


-.24 


+1.08 


+.65 


Nonpersonnel costs 


+.03 


+.71 


+.41 


Budgeted costs 


-.17 


+1.13 


+.67 


Contributions 


+.69 


+.89 


+.75 


Total 


+.49 


+1.28 


+.92 



Further breakdowns in the cost data are discussed in the sections below 
that examine Budgeted Costs and Contributions . 
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Table 3.9 



Mean Personnel Costs Per Child Per Year 
(Standard Deviation) 



Variable 


CD 


MD 


Half 


Full 


Half 


Full 


Direct instruction 
- Teacher 


2015.8 

1042.91 
(86.42) 


2237.0 

1427.45 
(691.59) 


1702.4 

1090.13 
(287.34) 


2668.0 

1872.27 
(792.25) 


- Aide 


436.64 
(215.14) 


493*82 
(239.48) 


322.33 
(164.57) 


504.33 
(302.57) 


- Speech 


375.36 
(184.60) 


282.18 
(138.43) 


130.20 
(172.91) 


196.00 
(196.37) 


- PT/OT 


101.18 
(161.60) 


26.91 
(41.52) 


89.07 
(232.04) 


86.07 
(145.29) 


- Music, ai t, PE 


59.73 

(23.47) 


6.73 
(22.31) 


70.67 
(8.07) 


5.87 
(26.04) 


Preparation 


379.09 
(127.23) 


500.27 
(296.62) 


581.33 
(144.55) 


601.20 
(294.38) 


Travel 


410.27 
(132.84) 


618.09 
(280.28) 


247.13 
(166.36) 


779.20 
(681.84) 


Parent contact 


$5.00 
(109.15) 


84.64 
(97.36) 


m 


114.40 
(96.81) 


CAPER 


149.64 
(48.48) 


122.18 
(97.02) 


94.53 
(32.15) 


163.33 
(90.56) 


Inservice, Other 


ooc •UU 

(114.17) 


(213.15) 


(133.14) 


" 301 11 
(257.10) 


Consultant 


84.00 
(114.89) 


55.18 
(18.99) 


49.47 
(108.52) 


66.07 
(21.30) 


Sp Ed - admin 


284.55 
(62.69) 




230.00 
(51.40) 




Principal/sec - admin 


359.00 
(0) 


284.18 
(136.71) 


355.00 

(0) 


298.47 
' (128.74) 


AEA - admin 


1655.00 
(0) 


1655.00 

(0) 


1655.00 

(0) 


1655.00 

(0) 


Total personnel costs 


6158.73 
(729.98) 


5955.36 
(949.60) 


5208.20 
(856.06) 


6588.40 
(1283.38) 



35% more aide services. Full-day CD children received 24% less teacher 
services, 44% more speech services, 69% less PT/OT services than full -day MD 
children. 

A comparison of costs for only CD children shows only $221 per child 
difference in direct instruction between half- and full-day (11% higher). 
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The largest contributors to the high cost of half-day programs for CD 
children is the fact that half-day CD children receive over twice as many 
hours of expensive specialist time (speech, physical, and occupational 
therapists) as do CD children in the full-day program. A breakdown of 
contact hours by intervenor is shown in Table 3.10 



Table 3.10 

Mean Contact Hours Per Child Per Year 
(Standard Deviation) 



Variable 


CD 


MD 


Half 


Full 


Half 


Full 


Teacher 


58.82 
(15.19) 


137.64 
(46.19) 


69.33 
(23.70) 


146.87 
(41.96) 


Aide 


50.45 
(29.62) 


125.36 
(61.97) 


51.47 
30.87) 


113.87 
(68.88) 


Speech therapist 


33.73 
(11.85) 


18.73 
(8.45) 


11.40 
(12.95) 


13.60 
(13.31) 


Physical and occu- 
pational therapist 


9.73 
(14.70) 


1.55 
(2.34) 


8.2 
(15.94) 


4.73 
(8.58) 


Music, art, PE 
teacher 


4.45 
(.82) 


.64 

(2.11) 


4.73 
(.80) 


.93 
(2.46) 


Total contact hours 


157.18 
(43.88) 


-283.91 
(78.63) 


145.14 
(45.55) 


280.00 
(75.84) 



Although CO teacher ard a-ide contact hours are higher in the full-day 
program, this expense is not enough to offset the high salaries paid for 
professional therapists. As indicated in Table 3.10, the therapy hours 
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Budgeted costs , Surprisingly, when only CD children are considered 
(Table3.6),the full-day program 1s -slightly less expensive than the half-day 
program ($199 per child or 3%). Although, when CD and MD children are 
considered as a group, the full-day program costs 15% more than the half-day 
program ($866 per child), and when only the MD students are considered, the 
full-day program costs 32% more than the half-day programs ($1647 per child). 
The most striking question raised by Table3.6is "Why does the half-day 
program cost more than a full -day program for a CD child but not for an MD 
child?" 

Although the difference between half- and full -day programs is only $199 
per child, the half-day program is quite a bit more expensive than one would 
expect when considering that the half-day program is approximately half the 
hours of the full-day. The detailed cost analysis conducted for this study 
identified several reasons why the costs of half-day programs are higher than 
one would intuitively expect. As shown in Table 3.6 most of the cost 
differential is found in personnel costs. 

Table3.9 presents a breakdown of costs for 10 major personnel activities. 
The costs for Direct Instruction (or contact time) is subdivided by type of 
intervener. Using costs for MD children as the standard, overall, full -day 
personnel costs are 27% higher than half-day costs. A comparison was made to 
determine in which areas CD costs were patterned differently from MD costs. 
These areas were direct instruction, travel, parent contact, CAPER, and 
consultant. 

First, in the area of Direct Instruction, full-day MD costs were $437 
higher than CD, and half-day MD costs were $313 lower than CD. Why did 
personnel costs fluctuate so dramatically across handicaps? Half -day CD 
children received 188% more speech services than half-day MD children and 
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represent 38.2% of total instructional hours for the half-day program but 
only 7.7% of full-day instructional hours. This high number of hours of 
therapy in half-day program has a big impact on costs because 38% of the 
time, two professionals are working with the children: the classroom teacher 
and the therapist. This situation happens only 8% of the time in full-day 
programs. Also, w,.2n one child spends time with a therapist, the cost per 
child of the teacher's salary increases for those children remaining in the 
classroom. MD children received more speech time in the full-day program and 
more PT/OT time in the half-day program. 

Table 3 # ii shows the costs of providing one hour of contact time by 
intervenor for only those children receiving services. For example, all CD 
children were seen by the teacher, aide, and speech theraoist, but only five 
(half) and four (full) by the PT/OT. Results show that per hour costs for 
therapists are higher (for both CD and MD) in the full-day program. The 
reason for this differential is due to the more frequent occurrence of 
individual child sessions in full-day programs (the half-day program used 
more small group sessions) and the more frequent use of therapist aides in 
the half-day program. 

Table 3.11 

Mean Cost P.jr Contact Hour Per Child Per Year 
for Only Children Receiving Service 



Variable 


CD 


MD 


Half 


. Fun 


Half 


Full 


Teacher time 


$17.73 
(N-ll) 


$10.37 
(N-ll) 


$15.72 
(N-15) 


$12.34 
(N-15) 


Aide time 


8.65 
(N-ll) 


3.94 
(N-ll) 


6.26 
(N-15) 


4.43 
(N-15) 


Speech therapy 


11.13 
(N-ll) 


15.07 
(N-ll) 


11.42 
(N-13) 


14.41 

(N-12) 


PT/OT 


10.40 

(N«5) 


17.41 
(N-4) 


12.67 
(N=7) 


18.18 
(N-8) 
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An examination of travel time (Table 3.9) shows full-day programs at a 
higher cost.. Most travel time costs are due to therapists and consultants 
who must travel to the schools, Full -day programs are located in rural areas 
up to 100 miles from the therapists' and consultants' base. Half-day 
programs are located within 10 miles. Proportionally higher travel costs for 
CD half and MD full are due to those children receiving more therapy. 

Although no parent contact hours were reported for half-day MD children, 
this appears to be an anomaly because of the teachers and children in sample. 
CAPER time would not be expected to differ across programs and seems to 
fluctuate only with MD half-day children, most likely due to the teachers in 
sample. Consultant spent more hours with half-day teachers of CD children 
with teachers of MD children. This was largely attributable to the faster 
growth rate of CD children. Visits to full -day programs were made regardless 
of handicap. 

Comparing personnel cost differentials across handicaps for only the 
half-day program, CD children had 22 hours per child more speech therapy than 
MD children did (Table 3.10). Because of more therapy hours, the CD children 
required more therapist preparation time and travel time. The cost of parent 
contact time for each CD child was $95 (Table"3'.9). No parent contact was made 
for MD children. Finally, half-day costs for inservice (and Other) and for 
CAPER testing time were higher for the CD children ($511.64) than the MD 
children ($392.06) (Table'3.9). Overal 1 , Personnel costs across handicap for 
only the full -day program, show costs for MD children to be 11% higher than 
costs for CD children. MD children were associated with more teacher and 
PT/0T time, more preparation time, higher travel costs, more parent contact, 
and more CAPER testing time (Tables 3.9 and 3.10) . CD children received more 
speech therapy. 
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Nonpersonnel costs include transportation (costs to operate bus), 
equipment (including furniture), and facilities (rental value, Insurance, 
maintenance, and utilities) (see Tab le 3.12) . For all children, total half-day 
costs were lower than full-day costs. However, the equipment costs for half- 
day CD children were 1.17 standard deviation units higher than for full-day. 
This high cost was attributable to the more frequent use of tape recorders 
and record players in the half-day program. 



Table 3.12 

Mean Nonpersonnel Costs Per Child Per Year 
(Standard Deviation) 



Variable 


CD 


MD 


Half 


Full 


Half 


Full 


• 

Transportation 


104.55 
(34.67) 


185.00 
(201.88) 


107.33 
(29.69) 


114.73 
(147.07) 


Equipment 


544.45 
(132.55) 


336.36 
(226.45) 


421.40 
(48.40) 


420.67 
(237.33) 


Facilities - school 


519.73 
(113.74) 


661.73 
(214.03) 


414.20 
(41.75) 


685.67 
(285.54) 


Facilities - AEA 


225.00 
(0) 


225.00 
(0) 


225.00 
(0) 


225.00 
(0) 


Total nonpersonnel 
costs 


1393.73 
(262.23) 


1408.09 
.(564.87) 


1167.93 
(96.25) 


1446.07 
(518.00) 



As shown under Budgeted costs in Table 6, full-day programs for MD 
children are $667 per child more expensive than full -day programs for CD 
children. The major cost differential is due to travel. MD children have 
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higher transportation costs (bus driver's time, bus maintenance, and gas) 
than do CD children. Because full-day programs are in the rural areas, some 
districts bus children to another district for service rather than maintain 
classrooms with special programs. MD children are bused from other districts 
more frequently than are CD children. 

A secondary cost differential results from MD children receiving more 
physical and occupational therapy than CD children. More therapy hours 
increases the costs of therapy equipment and travel. Travel costs for 
therapist traveling in rural areas (full-day program) are high in proportion 
to the hours of therapy provided to the children. For MD children, the cost 
of therapist travel is 276% of the cost of therapy time, and 20056 for CD 
children. Finally, more time has been allocated to preparation for MD 
children than CD children by the classroom teacher and the therapists. 

Contributed costs . Thus far, only costs appearing in district budgets 
have been considered. A comprehensive cost analysis requires a consideration 
of contributed as well as budgeted costs. The cost of contributed goods and 
services are presented in Table 3.1.3. It is expected that contributions would 
be similar across programs, however, children in full -day programs (both CD 
and MD) received substantially more contributed goods and services than the 
children in the half-day program. Parents contributed considerably more to 
the full-day program than parents contributed to the half-day program. An 
analysis of these parent contributions shows that parents of children in 
full -day programs spend over twice the hours conducting intervention programs 
in the home (297 hours) than parents of children in half-day programs (136 
hours). Other major parent contributions in full-day program were 
transportation and lunch. 
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Table 3.13 

Mean Contributed Costs Per Child Per Year 
(Standard Deviation) 



Variable 


CD 


MD 


Half 


Full 


Half 


Full 


Parents 

Intervention time 


316.18 
(184.25) 


945.64 
(2089.58) 


319.07 
(306.68) 


441.67 
(415.84) 


Transportation 


46.27 
(153.47) 


301.00 
(477.39) 


39.27 
(152.08) 


156.13 
(275.88) 


Home space 


9.64 
(4.92) 


20.36 
(21.74) 


11.40 
(12.40) 


19.93 
(19.06) 


Lunch 


m 


89.55 
(58.69) 




102.73 
(66.01) 


Snack 


8.18 
(1.89) • 


32.09 
(49.29) 


6.27 
(.70) 


15.60 
(4.52) 


Government lunch 


m 


37.27 
(64.57) 




32.33 
(55.95) 


Other 


m 


55.09 
(94.35) 




13.47 
(52.16) 


Total contributions 


380.27 
(192.97) 


1481.00 
(2139.38) 


376.00 
(365.23) 


781.87 
(459.95) 



Interestingly, the parents of CD children in full-day programs 
contributed 199% more time than parents of half -day children and 114% more 
than full-day CD parents. District personnel provided additional information 
to help interpret these findings. Staff believe parents of CD children to be 
typically more cooperative with home intervention programs than parents of MD 
children. However, parents of half-day CD children are frequently single 
working mothers. Mothers of full-day CD children are more often married and 
nonworking which would permit more avaialble time for home intervention. 
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Total costs including contributed and budgeted costs are included were 
given in Table 3.6. When contributed costs are added to budgeted costs, the 
patterns observed earlier when only budgeted costs were examined change 
considerably. Now full-day programs are more expensive for both CD children 
(20% more) and MD children (10% more). Most of this change is attributable 
to parent contributions via spending time with their child in tutoring-type 
activ ies. Although parents of both CD and MD full -day children spend more 
time tutoring their child than parents of half-day children, the differential 
is much greater for parents of CD children. 

* 

Considering Cost and Effects Data Together 

With the results of the outcome data, the budgeted costs, and the 
contributions, it is now possible to examine the question of cost 
effectiveness for half- and full-day programs for handicapped preschoolers *n 
AEA #12. As will be shown below, the final answer to questions of cost 
effectiveness depend to some degree on how decision makers value various 
types of resources (e.g., "out-of-pocket" versus contributed resources) and 
outcomes (e.g., cognitive growth versus expressive language growth versus 
other unreported variables). This section will present information on the 
overall cost effectiveness of the two program options, potential for 
increasing cost effectiveness, and the assumptions and limitations of this 
particular study. 

♦ 

Overall cost effectiveness . Table 3.14summarizes the data showing the 
program that provides the highest scores and the lowest costs for 1 ^h CD and 
MD. If only budgeted costs are considered, full-day programs for CD children 
are more cost effective (i.e., less expenditures and greater gains) than are 
half-day programs. However, for MD children, half -day programs are more cost 
effective because the gains for MD children in half -day programs are equal to 
or better than full-day programs, but the costs are less. 
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Table 3.14 

Display of the Highest Scores (+) 
and Lowest Costs (+) 



Variable 


CD 


MD 


Half 


Fun 


Half 


Fun 


Effectiveness 

Expressive 
Cognitive 




+ 
+ 


+ 
+ 




Costs 










Budget 




+ 


+ 




Contributed 


+ 




+ • 





When costs of contributions are included in the total costs, the^nswers 
are less clear. Full -day programs for CD children, which resulted in greater 
scores now cost more. Whether the higher soreis worth the extra cost is a 
value judgment which must be made by local decision makers. More 
interesting, however, is the possibility that the extra gain for CD children 
in full -day programs may be attributable to additional parent involvement. 
As discussed earlier (see Table 3U3)parents of CD children in full-day 
programs contributed more than three times as much as parents in half-day 
programs ($1389/child versus $380/child). 

By far the highest contributions of intervention time were made by 
parents of CD children in full-day programs. . Perhaps the higher scores by 
full -day CD children are because of extra parent involvement. What would 
happen with scores of CD children in half-day programs if parents were 
involved at the same or higher levels? Also, if parent involvement is the 
key, why aren't the scores of MD children in full-day programs higher? Is it 
possible that parents can be more effective interventionists with CD children 
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than with moderately or severely delayed MD children? Answers to such 
questions will require further research,. but the preliminary data obtained 1n 
this study are both enlightening and provocative. 

Potential for increasing cost effectiveness . In addition to questions 
of final status, a cost analysis such as the one conducted for these programs 
provides important information about potential program modifications which 
may contribute to improvements . in the cost effectiveness of a particular 
alternative. Described briefly below are several activities or situations 
which account for a seemingly high proportion of costs in one or both 
programs. 

Therapy in full -day programs . First, therapists who provide 
service to children in the rural areas often travel long distances 
for each visit made to a school district (often only one hour). 
The breakdown of the therapist salary for providing therapy in 
rural areas is one-third for instruction and two-thirds for travel 
time. The cost for therapy in full-day programs is considerably 
higher than it would be if the therapist were located closer to the 
school district. This raises questions about the cost 
effectiveness of providing therapy in a rural setting. 

Consultants in ful 1-day programs . The cost of providing AEA 
consultants to the rural sites is also quite high due to the cost 
of travel. Most of the cost of providing consultants once a week 
or biweekly is to cover the one- or two-hour round travel. Not 
only is time on the road covered by salary, but gas and car upkeep 
is reimbursed through travel vouchers. 

Engaged learning time . Although the evidence is not conclusive 
because data were based on teacher recall of a "typical week," 
there is some indication that the amount of engayed learning time 
in a full-day program is not much higher than it is in the half-day 
program. This apparent discrepancy occurs because of more frequent 
breaks and the fact that major activities in the afternoon hours of 
the full -day program consist of lunch (1 hour) and nap time (45 
minutes) . 

Use of parents as interventionists . As noted earlier, parents are 
used as interventionists much more extensively in full-day programs 
than in half-day programs.' To the degree that parents are 
effective interventionists, this will have dramatic impact on both 
costs and effects. 
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Music, art, and PE programs . Children 1n half-day programs are 
provided with much more Instruction 1n music, art, and PE. Because 
the costs of providing these programs are high, the 
cost/Instructional hour for half-day programs 1s increases 
Whether such programs should be offered 1s again a value judgment 
But, because the outcome measures used 1n this study did not test 
for changes that would be brought about by musk, art, and PE 
gains per dollar spent would be reduced. 

Differentia l levels of therapy . The amount of speech therapy 
provided for children 1n half-day programs (see Table%) is 
at least double that given to children in other condition?. This 
1s surprising and it is questionable whether the amount of therapy 
given has surpassed the point of diminishing returns. Further 
Investigation 1s needed to explain why CD children in half-day 
programs receive more therapy than children in other programs and 
whether this additional therapy can be justified in terms of child 
growth . 

When making a comparison of "half-day" versus "full-day" programs, there 
is a danger that people will incorrectly conceptualize the two alternatives 
as fixed, discretely defined, and unchangeable. It must be remembered that 
all results reported in this study are based on programs as they were operat- 
ing at the time of the study. As should be obvious, there are many ways in 
which full-day and/or half-day programs could be 'altered (such as those 
mentioned above) and still remain a full-day or half-day program. Such 
changes could easily change either the costs or the effectiveness of the 
program. 

Assumptions and limitation s of this study . The data reported herein are 
based on a number of assumptions and limitations which are important to keep 
in mind as the results are interpreted. First, the validity of all 
conclusions rests on the assumption that children in full-day anJ half-day 
programs were comparable in every way at the beginning of treatment except 
for the type of program in which they. were enrolled. To assure 
comparability, the final sample of children were carefully matched on 
variables of age, time in program, and various measures of developmental 
progress at the time of program entry. 
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Second, it is possible that factors only tangential ly related to the 
half-day/full-day comparison could have skewed results (particularly for the 
cost data). To protect against this, the analyses considered as many 
alternative explanations as possible. For example, average teacher salary 
for each group was checked to see if the more senior (and hence the more 
expensive) teachers just happened to be teaching the children selected to be 
in one of the four groups (half-day CD, MD; full -day CD, MD). There were no 
statistically significant differences in teacher salary between groups. 
Also, number of children per class was examined and there were no differences 
between groups. Based on the interviews and on-site observations, it was 
concluded that there were no differences between curriculum materials, 
operating procedures, philosophical orientation, or unusual therapy 
requirements which would confound the half -day versus full -day programs. 

•Finally, outcomes in this study were limited to the cognitive and 
expressive language strands of the CAPER which are highly correlated with 
well-established standardized measures. These measures provide a good data 
base, but further valuable data could be obtained by collecting data in other 
developmental areas using diagnosticians who are blind as to the purposes of 
the study. Also, this study was limited to outcomes in cognitive and 
expressive language growth due to the availability of CAPER scores. This 
does not imply that other variables such as improved family functioning or 
reduced family stress are not equally important outcomes. Future cost- 
effectiveness analyses of these programs should attempt to cast as broad a 
net as possible for outcome me-asures. 
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Conclusions 

This study was designed to provide Initial data on a cost- 
effectiveness comparison of half-day versus full-day programs to demonstrate 
the utility of a comprehensive economic model for cost analysis and to 
identify strategies for further cost-effectiveness analyses for half-day 
versus full -day programs for preschool handicapped children. 

Initial Data on Cost Effectiveness 

Assuming the programs continue to function as they are now functioning, 
for CD children, the full -day program 1s more cost-effective If contributed 
parent time is Ignored. In other words, higher gains are achieved at lower 
costs. If parent time is included, one must decide whether the additional 
costs of full -day programs are justified by the higher gains. For MD 
children, the half-day program 1s more cost effective whether or not parent 
time 1s considered. In other words, similar test scores are received by MD 
children in the half- and full -day programs, but half -day programs cost 
less. 

Utility of a Comprehensive Economic Model for Cost Analysis 

Two of the distinguishing characteristics of the economic model used in 
this cost-effectiveness analysis are that (a) all resources (budgeted and 
contributed) were accounted for, and (b) data were collected so they could be 
disaggregated to yield data with the child as the unit of analysis. Among 
the important insights gained as a result of this approach are the 
following: 

1. The ability to consider cost-effectiveness issue separately for CD 
and MD children even though they are taught in the same classes. 
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2. The differential amount of therapy for half-day CD children versus 
children 1n the other three groups. 

3. The differences 1n cost-effectiveness ratios when contributed parent 
time 1s Included or excluded for CD children and the possibility that 
additional parent time might be 1n part responsible for higher gains made by 
full-day CD children. 

4. The contributions to total costs for Individual children of 
activities such as consultant travel, therapist travel, art/music/PE 
activities, and shared facilities. 

5. The suggestion that amount of engaged learning time 1s very similar 
between half -day and full -day programs. 

Information such as that cited above would be unavailable in cost analyses 
which arrive at per student costs by dividing total budget figures by the 
number of children served. Yet, the type of data cited above is exactly the 
type of information needed by administrators to make valid decisions. 

Suggestions for Future Research 

The results of this study provide some initial information about the 
cost effectiveness of half-day versus full-day programs for preschool 
handicapped children. But like most initial studies, it also lays the 
foundation for further work. Based on these findings, it seems that studies 
in at lea*.t the following three areas should be pursued. 

Further post hoc cost-effectiveness studies . The study described in 
this report was a post hoc quasi-experimental design. In other words, 
children to be compared were in preexisting groups and were selected for 
inclusion in the comparison samples after the "treatment" was largely 
completed. Although there are inherent weaknesses in this type of a design, 
one can be quite confident of results 1f matching can be done on pretreatment 
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variables as was done in this case and if replications can be done with 
additional groups of children. Further work of the type described in this 
report would be valuable In the following areas. First, additional children 
could be included in the half -day/full-day samples because of new children 
entering the program. Second, more comprehensive objective outcome data 
(including family functions) could be collected by "blind" observers. Third, 
this study was limited to children who were enrolled In programs during the 
1982-83 year. Archival records at AEA #12 suggest that there are about 40 
half-day/full-day matched pairs of CO and MO children who have previously 
graduated from the preschool programs which could be included in a similar 
study. Including these children would allow an examination of the long-term 
cost effectiveness of the two programs. Fourth, much of the data collected 
in this study depended on teacher recall of a "typical week." More precise 
data for these variables could be collected by observation and selective time 
tracking. 

Effect of parent involvement. Data collected in this study suggested 
that the additional involvement of parents as interventionists with their 
full-day CD children may have been responsible for the higher scores of these * 
children. Although suggestive, the data in this study were by no means 
compelling. An excellent research study would be to randomly assign 
parent/child pairs of children (both CD and MR in both half-day and full-day 
programs) to experimental conditions involving:different levels of parental 
involvement (high, medium, low). More precise records on actual involvement 
and outcome measures in a variety of -areas could then be used to do a more 
definitive cost-effectiveness analysis of this variable. 

Randomly assigned compariso n of half versus full dav . A more rigorous 
approach to comparing the cost effectiveness of half-day versus full-day 
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programs would be to randomly assign children to either half-day or full -day 
programs and then collect the same types of cost and effects data as 
described earlier. This approach would avoid the problems inherent in quasi- 
experimental designs, but would also Involve substantial logistical and 
administrative difficulties. T herefore, 1t 1s recommended that such a 
possibility be reserved for the future until further data are collected using 
options such as those described above. 
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CHAPTER IV 

LONGITUDINAL STUDY OF EARLY INTERVENTION 
WITH HEARING IMPAIRED CHILDREN 

Introduction 

This research project was done to investigate the long-term impact of 
early Intervention on hearing impaired children. This study will be reported 
in five sections. The first section will include a problem statement and a 
discussion of the basic research questions. The next section will present a 
review of literature on early intervention programs for hearing impaired 
children. The third section will be a discussion of research methods and 
procedures and will include a description of the research model, sample 
selection, selection and development of measures, testing, and data analyses 
procedures. The fourth section will present the results of the study and a 
discussion. Finally, implications of the research project and recommenda- 
tions for future research will be discussed. 

Problem Statement and Research Questions 

Problem Statement 

Prelingual hearing impairment afflicts a relatively large number of 
children each year (approximately one in 1,500 births). The handicap of 
hearing impairment is particularly devastating to the child during the first 
few years of life when language acquisition occurs (Clark & Watkins, 1978; 
Northern & Downs, 1974), To ameliorate this serious problem, many early 
intervention programs for hearing impaired children have been established 
throughout the country during the past few years. 

One of the most successful and widely disseminated of these programs is 
the SKI*HI program which has been approved by the Joint Dissemination Review 
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Panel for national dissemination. The SKI*HI model has been used with over 
6,000 children during the last nine years and is currently being used with 
over 1,500 children in 90 sites throughout the country. 

The validation of SKI*HI for national dissemination was based on data 
from a quasi -experimental design where 33 children who received treatment 
prior to 30 months of age were compared to 27 children who were identified 
after 30 months of age and had not yet received treatment. Comparability of 
the two groups was established on degree and type of hearing loss, age, and 
other demographic variables. Comparison of the two groups demonstrated that 
the group with earlier intervention was significantly better on use of 
residual hearing, auditory development, receptive and expressive language, 
and parental involvement with their child's early education (Clark, 1979). 

Unfortunately, there are no data on these hearing impaired children to 
determine the long-term effects of early home programming on them. Since the 
untested assumption upon which these intervention programs are operating is 
that early gains will be maintained and will impact on other areas, there is 
vital need for research to be conducted on the long-term impact of early 
intervention on hearing impaired children. 

Any serious effort to examine the cost-effectiveness of early 
intervention for the hearing impaired would have to consider the effect of 
these long-term outcomes. Therefore, since such longitudinal data are 
lacking, it is impossible to fully justify continuance of the national and 
local resources being used in early intervention programs for the hearing 
impaired. 

Perhaps, knowledge of the long-term impact of early intervention is most 
important for hearing impaired children and their families. Longitudinal 
data are needed to help these deaf youngsters and their families know if 
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they are receiving services that provide positive impact on their lives beyond 
treatment time. 

Research Questions 

The main purpose of this study was to investigate the long-term impact of 
home intervention on hearing impaired children. The basic research question 
that emerged was, "Do hearing impaired children who received home intervention 
earlier in their lives perform better than hearing impaired children who did 
not receive home intervention earlier in their lives on measures of language, 
academic achievement, and psycho-social behaviors?" In addition to this most 
basic question, two other important questions emerged: "Do children who 
received home intervention before age 2 1/2 perform better than children who 
did not receive intervention until after age 2 1/2 on measures of language, 
academic achievement, and psycho-social behaviors?" "Do children who received 
no home intervention but attended preschool perform better than children who 
did not receive home intervention and did not attend preschool on measures of 
language, academic achievement, and psycho-social behaviors?" 

Review of Literature 

During the last 15 years, there have been only a very few studies done 
on the long-term impact of early intervention for hearing impaired children. 
The large majority of these studies have investigated the effects of child- 
oriented, center-based programs (prescnools or nursery schools) on hearing 
impaired children. Only a very few studies have investigated the impact of 
parent programs on hearing impaired children and none of these studies have 
looked specifically at home (versus center-based) parent programs such as the 
SKI*HI program. 
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This review of literature contains first a discussion of the studies that 
have been done on the long-term effects of center-based, child-oriented pro- 
grams on hearing Impaired children. Next, a discussion of studies done on the 
impact of parent programs on hearing impaired children will be presented. 

Chi Id-Oriented Intervention with 
Hearing Impaired Children 

The studies on the long-term effects of nursery and preschool programs on 
young hearing impaired children are inconclusive. Research done primarily 
during the 1960s did not yield conclusive evidence for positive sustained 
Impact of preschool intervention. Craig (1973) administered comprehensive 
batteries of speechreadlng and reading tests to 151 children at the Western 
Pennsylvania School for the Deaf and the American School for the Deaf 
(Connecticut) who had attended preschool earlier 1n their lives. He also 
tested a control group of 101 children from the same institutions who had not 
attended preschool. He found no statistically significant differences between 
the experimental and control groups after the children had been in the primary 
grades for three to four years. Similar results were found by Phillips (1963) 
who tested 9-year-old severely and profoundly hearing impaired children from 
eastern United States schools for the deaf Including the Lexington School (New 
York) and the American School for the Deaf (Connecticut). No statistically 
significant differences- between the experimental preschool group and the 
control no-preschool group were found on measures of arithmetic achievement, 
language achievement, and socialization. 

Vernon and Koh (1970) compared children who had experienced three years 
of oral preschool (John Tracy Preschool Program) to children with no preschool 
who had: (a) oral home environments, and (b) manual communication home 
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environments. Groups were matched on age and IQ. There were 23 subjects in 
the experimental group and 23 subjects in each of the two control groups. 
Participation in preschool did not seem to be the determining factor of later 
academic achievement advantages. At age 18, children who experienced an oral 
preschool program did not score statistically significantly higher than the 
no-preschool children from oral home environments on the Stanford Achievement 
Test. However, the experimental preschool children scored statistically 
significantly lower than the no-preschool children from manual communication 
home environments on the Stanford subtests of paragraph meaning and reading. 

Balow and Brill (1975) did a follow-up study of the Vernon and Koh 
research. They studied 264 John Tracy Preschool Program graduates who were 
attending the California School for the Deaf at Riverside. This sample was 
considerably larger than the 23 subjects used in the Vernon and Koh study. 
The Tracy graduates were compared to other students at the Riverside School 
who had not had preschool programming. The John Tracy graduates scored 
statistically significantly higher on the Weschler Adult Intelligence Scale 
and on the total battery of the Stanford Achievement Test than the control 
group. An analysis of covariance showed that a statistically significant 
difference in achievement remained when the effects of IQ were controlled. 

Moores, Weiss, and Goodwin (1978) conducted a six-year longitudinal study 
on preschool programs for deaf children. Subjects included hearing impaired 
children who had attended seven different preschools which emphasized differ- 
ent communication methodologies. The hearing 'impaired children were shown to 
have almost identical scores to hearing children in the standardization sample 
on the Illinois Test of Psycholinguistic Abilities and the reading subtest of 
the Metropolitan Achievement Test Primer Battery. However, communication 
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success as measured by the Receptive Communication Scale (a tool developed by 
the research team) depended on the type of preschool program in which the 
children had participated. Children scored highest who had been 1n 
speechreading and signing preschool programs. These children were followed by 
those who had experienced speech and fingerspelling preschool programs; these 
were followed by children who had been in preschool programs utilizing speech 
and audition. Children scored lowest who had been in programs utilizing 
auditory receptive communication only. 

Intervention Directed to Parents of 
Hearing Impaired Children 

Most of the studies done on the long-term impact of parent intervention 
on hearing impaired children have involved center-based programs of parental 
instruction. Parents have received training in clinic settings or demonstra- 
tion home settings in how to provide meaningful language stimulation for their 
hearing impaired children. 

Lowell (1967) studied hearing impaired children whose parents had 
received training in a demonstration home while the children were 1 to 3 years 
of age. After the parents completed the program, the language growth of the 
children was monitored. Using the modified Boone Scales of Linguistic 
Encoding and Decoding, two groups of experimental children showed statistical- 
ly significant gains for months after the program was completed. Two control 
groups of children who had been enrolled in traditional nursery school and 
whose parents did not receive instruction did not show statistically 
significant improvement. 

Ewing and Ewing (1964) found that deaf children whose parents had 
received center-based guidance were linguistically superior to children whose 
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parents did not have the benefit of such training. Gains for the experimental 
children were statistically significantly greater than for the control 
children in the articulation of spoken English, use of colloquial English, 
vocabulary, spontaneity of vocalization, and variety of pitch and intonation 
during the first three to four years of elementary school. Parents who had 
received training were judged to be more cooperative with the school in 
continuing the child's home language training than control parents. Teacher 
interviews were utilized to obtain this information. 

Horton (1976) studied six hearing impaired second grade children whose 
parents had received training in the Mama Lere Demonstration Home. The chil- 
dren were 0 to 3 years at the time of intervention. Two control groups were 
also studied: (a) five hearing impaired second grade children whose parents 
had not received instruction (but who had been fit with hearing aids at a 
median age of 4 years), and (b) six hearing second grade children who were in 
the same school as the intervention group. The severity of hearing loss for 
the experimental and control hearing impaired groups was not statistically 
different. Fifty consecutive utterances produced by the children in each of 
the above groups were analyzed according to Lee's Developmental Syntax Types. 
The findings revealed that the language competence of the experimental group 
was not statistically different from the hearing control group. However, 
there were statistically significant differences between the experimental and 
no-intervention hearing impaired groups favoring the experimental group. For 
example, the intervention group produced, on an average, 75% of their 
utterances on the sentence level compared to only 32% for the no-intervention 
control group. Only 8% of the intervention group's utterances were of the 
noun type (immature construction) compared to 19% noun type construction usage 
in the control group. In the intervention group, 79% of the utterances were 
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mature verbal constructions while only 19% of the utterances in the control 
group were of this type. 

In another study, Horton (1976) compared six hearing Impaired second 
grade children whose parents had received training 1n a demonstration home to 
53 hearing second grade children. The Metropolitan Achievement Test was given 
to both groups. The mean percentile ranks for both groups were virtually 
equivalent 1n the area of reading. The hearing impaired children scored 
slightly lower on the math subtest. 

Studies on the long-term effects of home visit programs for parents of 
hearing impaired children (such as the -<I*HI Program) have not been reported 
in the literature during the last 15 years. Lack of research on such 
programming is most unfortunate because: 

1. Parent-oriented programs have been shown to have longer lasting 
positive effects on children than child-oriented programs without 
parental participation (Bronfenbrennc *, 1974). 

2. Home programs are claimed to be superior to clinic or demonstration 
programs because: 

a. The home is the parents' and child's natural environment. 

b. Intervention in the home allows for utilization of natural prime 
times for language stimulation (such as bath time, getting child 
dressed, etc.) (Clark & Watkins, 1978; Shearer & Shearer, 1976). 

c. In home programming, parents do not need to get dressed and. go 
out to a center. Near 100% attendance was reported by Watkins 
(1971) in the Utah home visit parent infant program. 

d. Studies done on' home visit parent programs for other handicaps 
such as visual impairment and mental retardation reveal that 
these programs are more cost effective than center-based parent 
programs (Macy & Carter, 1980). 
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It 1s evident, then, that research on the long-term effects of home visit 
parent programs (such as SKI*HI) .is greatly needed. 

Summary 

The scanty research available on long-term effects of preschool 
programming for hearing impaired children 1s inconclusive. Studies done 
during the 1960s reveal that children who experience preschool do not score 
higher on academic achievement than control children. However, 1n later 
studies, it 1s shown that children who attended preschool are comparable to 
hearing controls or superior to hearing impaired controls on some academic 
measures. Some research indicates that the type of preschool program 
(favoring sign language utilization) may be a more Important indicator of 
later academic success than participation in preschool per se. 

Studies have been done on the long-term impact of center-based programs 
for parents of young hearing impaired children. Children whose parents have 
been in these programs show .,r<.ater language competence and academic 
achievement in the first few primary grades than children whose parents have 
not participated in such programs. Research on the long-term impact of home 
visit parent programs (such as the SKI*HI model) is not available. 

Methods and Procedures 

Research Model 

The research model used in the study was a longitudinal research design 
which studied the relationship over time of home intervention to language, 
academic achievement, and psycho-social performance of hearing impaired 
children. The design was sinvilar to the Stanley and Campbell ex post facto 
design because treatment administration (home intervention) had already 
occurred and current performance levels were assessed. The general 
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statistical model used was analysis of covarlance and multiple comparison 
procedures. Specific measures were taken to control for threats to internal 
and external validity that were inherent in the research model as shown in 
Table 4.1. 

Sample Selection 

In order to examine the issues of home intervention vs. no-home 
intervention, early vs. late home intervention, and preschool vs. no 
preschool, four research groups were selected. 

Group 1: Children who had a home intervention program (SKI*HI) before 
age 2 1/2 and who attended preschool. 

Group 2: Children who had a home intervention program (SKI*HI) after age 
2 1/2 and who attended preschool. 

Group 3: Children who did not receive home intervention ages 0-5 but who 
did attend preschool. 

Group 4: Children who did not receive home intervention ages 0-5 and who 
did not attend preschool. 

The subjects for groups 1 and 2 were children who participated in a study 
done by Clark and Covert (Clark, 1979). In this study, 33 children who had an 
average 9 months of treatment before age 2 1/2 were compared to 27 children 
who had no treatment until age 2 1/2. < 

In this current research study, the early treatment children in the Clark 
and Covert study were matched to the late treatment children in that study on 
the variables of hearing loss, age, existence of other handicaps, and 
preschool attendance. Attrition attributed to parent refusal to include the 
children in the study, out-of-state moves, and unsuccessful matching, resulted 
in a final N of 23 for both groups. These children had received treatment 
earlier in their lives in the form of the SKI*HI model. This model contained 
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Table 4.1 



Controls for Threats to Internal end External Validity 



INTERNAL VALIDITY: 
1. History: 



2. Maturation; 



3. Testing 

4. Instrumentation 

5. Regression 

6. Mortality 

7. Differential Selection 



EXTERNAL VALIDITY: 

1. Interaction of Testing 
and Treatment 



2. Interaction of Testing 
and Treatment 

3. Reactive Effects 



4. 



5. 



6. 
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Multiple Treatment 
Interference 



General i zab1 lity to 
Other Treatment 

Genera 1 i 2abi lity to 
Other v*asure$ 

Ge-e-ai • :abi lity to 
0*.ne- *f~-9S (beyond 
wee at* dc*:« 



a. Control group used. (Likely same historical factors operated on 
experimental and control children so history non-differential). 

b. Factors suspected of differential Influence were either matched or, If 
highly correlated with dependent variables, were treated as covarlates: 

1) amount and type of preschool 

2) amount and type of therapy 

a. Control group used. (Likely same maturation factors In operation for 
control and experimental children so maturation non-differential). 

b. Factors suspected of differential influence were either matched or, 1f 
highly correlated with dependent variables, were treated as covarlates: 

1) age 

2) bouts with middle ear Infections 

a*. There were no pretest effects on child scores. 

a. Diagnosticians blind to group membership of children. 

b. Fixed Instrument used. 

c. All tests given during same two-week period. 

a. Groups were not selected on basis of extreme prescores. 

a. Attrition rates were slightly different between groups 1 and 2 (30S and 
15* respectively). However, no reason to suspect differential attrition 
(such as children moving out of state). 

a. Factors suspected of being different for groups matched or, If highly 
correlated with dependent variable, treated as covarlates: 

1) hearing loss 

2) other ha Heaps 

3) current school placement 

4) Index of social position (occupation and education of parents) 

5) age of parents 

6) number of parents 

7) hearing status of parents 

8) amount of treatment (for groups 1 and 2) 

9) lapsed time since treatment (for groups 1 and 2) 



a. Pretests were not given so possibility did not exist of subjects' 
responses (as a result of pretest effects) being r,*n-genera11zab1e to 
untested populations. 

a. Study purports general1:ab1 lity of results only to populations of hearing 
Inpalred children with characteristics similar to children in this study. 

a. Children too young during treatment to be subject to reactive effects. 

b. At testing time, all children simply informed they were to participate in 
some activities to see how well they were doing in school. Tnerefore, 
John Henry Effect (subject attest to prove or disprove treatment theory) 
not 1 1kely a problem. 

c* Since hearing impaired children are regularly tested, Hawthorne effects 
(Improved or worsened performance as a result of "test takino") 
minimized. 

a. Series of treatments were not given so possibility did not exist of one 
treatment distorting another treatment, making test results of any one 
treatment ungenet allzable to other treatment applications. 

a. Treatment given by different parent advisors. 



a. Multiple measures used. 



Since an important purpose q? %r\\% study was to de:e**1ne cwC • 
treatment effect (beyond imfteciate post-treats: tir-e), tnis *as 
/threat. However, study purports generalirasi Hty c? treatment 

tmr.<6 tim«< h»vnrtf1 fr* affront nf rh11rtr*n inr!„.lAr. \r, tnU 
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a child Identification component, regular weekly home visits by a professional 
to the child's home, and medical ,. audlologlcal , and psychological ancillary 
services (see description of treatment 1n Appendix 4-A). At the time of the 
current study, children 1n groups 1 and 2 were in 31 schools scattered 
throughout the state of Utah. 

Children in groups 3 and 4 were selected from a pool of sites that did 
not have a home Intervention program 1n existence long enough to yield 
"graduates" currently 6-13 years of age. Four sites were selected from this 
pool : 

1. Tennessee School for the Deaf, Knoxvllle, Tennessee. 

2. Alabama Institute for the Deaf, Birmingham, Alabama. 

3. Memphis Oral School for the Deaf, Memphis, Tennessee. 

4. Local school districts in Utah and Idaho (Cache County School 
District, Logan, Utah; Logan City School District, Logan, Utah; 
Preston School District, Preston, Idaho). > 

Children from these sites were carefully matched with the children in 
groups 1 and 2 on four variables listed above. A total N of 96 (23 in each of 
the four groups) resulted. 

Selection and Development of Measure? 

Fifteen SKI*HI Model Impact areas were defined and a group of 
professionals who work with the model were asked to rate how the impact areas 
were directly affected by the intervention program. They rated nine impact 
areas as most important. Outcome variables for these nine Impact areas were 
then defined and included ch.i'ld receptive and expressive language, 
communication, academic achievement, speech, social -emotional adjustment and 
self-concept, and parent attitudes, communication, and hearing aid 
management. 
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Potential instruments to measure these outcome variables were next 
carefully researched. It was determined that appropriate measures were not 
available for parent attitudes, communication, and hearing aid and 
communication management. So instruments to measure these variables were 
developed specifically for this study (see measures in Appendix 4-B, 4-C, and 
4-D and description of development of measures in Appendix 4-E). Commercially 
available measures were obtained for the other outcome variables. 

Table 4.2 contains a list of the outcome variables and the Instruments 
used to measure those variables. 

Testing 

Clearance was obtained to test the human subjects in this study from the 
Utah State University Institutional Review Board. Clearance was also obtained 
to conduct child testing from the parents of each child in the study and from 
the administrator of the school each child was currently attending. 

Eight diagnosticians were recruited and were given three days of training 
at Utah State University to administer all the measures (see Training Agenda, 
Appendix 4-F). The diagnosticians were graduate students in Communicative 
Disorders and Special Education at Utah State University who knew sign 
language and had experience or course work in psychometrics. 

The diagnosticians conducted child testing at 37 schools in Utah, Idaho, 
Alabama, arid Tennessee. All testing was done in a two-week period of time. 
Each child received two 1-1/2-hour test sessions over cwo days. 

Parent Attitude Scales and Parent Questionnaires were sent to all parents 
of the children in the study.' Eighty-four percent of the parent attitude 
scales were returned =»nd all information was return . on the parent 
questionnaires. 
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Table 4.2 



Outcome Variables and Measures 



Outcome Variable 


Measures 


1. Receptive language 


1. Carrow Test of Auditory Comprehension 
of Language '. 

2. Peabody Picture Vocabulary Test 


2. Expressive language 


3. Lee's Developmental Sentences Scoring 

4. Express.ive One-Word Picture 
Vocabulary Test (Gardner) 


3. Communication 


5. Communication Inventory and Teacher 
Rating (developed for this study) 
see Appendix 4-B 


4. Academic achievement 


6. Woodcock-Johnson Psycho-educational 
Battery: Part II. Tests of 
Achievement (Reading, Math, Written 
Language) 


5. Speech 


7. Arizona Articulation Proficiency Test 


6. 5oci a i -emoti onai aooustment, 
self-concept 


Assessment Inventory for Deaf 
Students • 


7. Parent attitudes 


9. SKI*HI Parent Attitude Scale 
(developed for this study) 
see Appendix 4-C 


8. Parent management of hearing aid 


10. Parent Questionnaire (developed for 
this study) see Appendix 4-D 


9. Parent communication 


11. Parent Questionnaire (developed for 
: this study) 
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Data Analysis 

Tests were scored for use in. the data analysis in three major ways. 
First, commercially available tests were scored according to test protocols. 
Second, scoring procedures for instruments specifically designed for this 
study were devised and these measures were then scored. Finally, videotaped 
language sample and articulation tests were transcribed and scored according 
to instruction manuals. Because scoring of the Arizona articulation test 
required some subjective judgments as to the correctness of sound production, 
an interrater reliability study was don& ou 15 of the children in the research 
project. This study yielded a reliability coefficient of .96. 

In order to answer the basic research questions about differences 
between groups of children who received home intervention vs. no home 
intervention, early home intervention vs. late, and preschool vs. no 
preschool, analyses of covariance and multiple comparison procedures were used 
to determine these group differences. In addition, effect sizes to determine 
educational significance of the research data were determined. 

In order to perform these analyses, test scores obtained above on 36 
dependent variables were entered onto computer coding sheets along with 22 
potential covariates. The potential covariates were obtained from school 
record information, the Parent Questionnaire, and from an analysis of 
treatment data on children in groups 1 and 2 who participated in the Clark and 
Covert 1979 study. Coded data were then transferred to computer disk for 
analysis. 

Potential covariates were then correlated with the dependent variables. 
Six covariates correlated with most of the dependent variables at a level of 
.3 or higher and were subsequently selected as the final covariates to be - 
controlled 1n the analyses. They included hearing loss, age, existence and 
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severity of other handicaps, age of mother, Hoi Ungshead (1957) Index of 
Soda! Position (derived from the. parent education and occupation items on the 
Parent Questionnaire), and number of childhood middle ear infections. 
Multiple R's were obtained to determine the. relationship of each dependent 
variable to the covariates collectively. The larger the relationship 
(multiple R), the more need was evidenced to covary on the six factors. 

Next, overall differences among groups were obtained by performing a 
univariate analysis of covariance with multiple covariates. In this analysis, 
group differences were determined for each dependent variable while covarying 
on the six covariates. A multivariate analysis of covariance was also 
performed. Dependent variables were categorized into the four logical groups 
of language/communication, academic achievement, psycho-social behaviors, and 
parent attitudes. Group differences were then obtained for each dependent 
variable category while covarying on the six covariates. This measure 
provided additional indication that group differences existed and confirmed 
group differences for individual measures within dependent variable 
categories. 

Analyses of specific group differences were next performed on comparisons 
that were considered of primary importance because they dealt with the issues 
of home intervention vs. no home Intervention, early vs. late home interven- 
tion, and preschool vs. no preschool. In addition, analyses of specific group 
differences were obtained for other comparisons of secondary interest which 
compared one of the two home intervention groups to one of the two non-home 
intervention groups. Multiple t-tests were performed on pair-wise contrasts 
of all dependent variables that were statistically significant for the four 
research groups. These comparisons included group 1 vs. 2, 3 vs. 4, 1 vs. 3, 
2 vs. 3, 1 vs. 4, and 2 vs. 4. In addition, planned orthogonal contrasts 
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were used to compare combinations of group means with other group means. 
These comparisons included groups- 1 and 2 vs. 3, 1 and 2 vs. 3 and 4, and 1 
and 2 vs. 4. It is best 1f the comparisons in planned orthogonal contrasts 
are orthogonal to each other (independent of each other). It was determined 
that the group 1 and 2 vs. 3 and 4 comparisons were orthogonal. However, the 
other two contrasts were not orthogonal. This was not considered serious, 
however, since the alpha level was raised only slightly (increased chance of 
Type I error). 

Finally, it was determined if all primary and secondary comparisons were 
educationally significant. The technique used to obtain this information was 
effect size analysis. In this analysis, treatment groups were pitted against 
control groups such as the early home intervention group (treatment) vs. the 
late home intervention group (control). Effect sizes, or differences between 
these groups in terms of standard deviation units, were then determined. 

Results and Discussion 

Covariate Selection and Analyses of 
Overall Group Mean Differences 

Multiple R analysis . Since covarying was to be done on the six 
covariates collectively, multiple R tests were conducted to determine the 
relationship of the covariates to each dependent variable. The results of 
this analysis are in Table 4.3. 

Since the covariates account for over 60% of the variance of 11 dependent 
variables and over 50% of the variance of 24 dependent variables, the need to 
covary on the six factors is. obvious. 

Analysis of covariance . In order to determine overall group mean 
differences, two analyses of covariance were performed: univariate analysis 
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Table 4.3 



Multiple R's for Dependent Variable 



Dependent Variable 



Multiple R 



Woodcock Johnson Raw Scores: 
Letter/Word Identification 
Word Attack 
Passage Comprehension 
Calculation 
Applied Problems 
Dictation 
Proofing 

Peabody Picture Vocabulary Test: 
Raw Score 

Standard Equivalent Score 
Age Equivalent Score 
Test of Auditory Comprehension of Language Raw Score 
Communication Inventory Raw Score 
Communication Rating by Teacher 
Expressive One-Word Picture Vocabulary Test Raw Score 
Arizona Articulation Proficiency Test: 
Raw Score 
Consonant Score 
Lee's Developmental Sentence Scoring; 
Raw 
MLU 

Parent Attitude Scale: 
Total Raw Score 

Reactions to Outside Help Raw Score 

Anxiety/Guilt Raw Score 

Acceptance Raw Score 
Meadow-Kendall Social -Emotional Assessment: 

Social Adjustment Raw Score 

Self-image Raw Score 

Emotional Adjustment Raw Score 
Parent Questionnaire Raw Scores: 

Time Hearing Aid Worn 

Time Spent Reading 

% Solitary vs. Group Play 

Number of Friends 

Child's Attitude Toward School 



% of Child 



s Communication Understood by Family 

* of Child's Communication Understood by Non-Family 
% of Family Communication Understood by Child 

* of Non-Family Communication Understood by Child 
Time Spent Communicating With Child 

Child Behavioral Rating 



.60 
.58 
.66 ■ 

.73 : 

.64 
.61 
.61 

.57 
.55 
.58 
.63 
.59 
.49 
.61 

.74 
.71 

.52 
.56 

.47 
.44 
.46 
.41 

.55 
.51 
.51 

.52 
.21 
.38 
.24 
.45 
.59 
.60 
.41 
.40 
.55 
.23 
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of covariance with multiple covariates and multivariate analysis of 
covariance. Results of these analyses are shown below in Table 4.4. 

Mean scores are listed from highest to lowest with the group number in 
parentheses next to the mean. The possible number of points for each 
dependent variable is also given. 

It is important to note on variables 20-23, a larger mean represents a 
smaller percent of understood communication. Higher scores on three other 
variables also indicate poorer performance: variable 16 (where higher scores 
indicate more consonant errors), variable 30 (where higher percent scores 
indicate more solitary vs. group play), and variable 35 (where higher scores 
reveal poorer child attitudes toward school). 

Mean differences that are statistically significant at a .1 level are 
noted with asterisks. This alpha level is not considered too liberal 
(increased chance of Type I error) because of the following: 

1. High power values: 



(4 groups 23 subjects/group, 6 covariates) 

2. Effect sizes consistently favoring the treatment groups. 

3. Consistency of £ values of variables that are highly correlated. 
Total group standard deviations and within-group errors (MS e ) are given 

in the table. Also given are F values -for the Wilk's Multivariate Test along 
with the significance levels of these F values. 

Discussion . As revealed- in Table 4.4, statistically significant 
differences among groups exist for the majority (67%) of the dependent 
variables. In addition, when dependent variables are categorized into logical 



Medium-sized 
difference 



Large-'.; i zed 
difference 



a. Power at .05: 

b. Power at .1: 



82% 
89% 



99% 
99% 
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Table 4.4 

Results of Univariate Analysis of Covariance with Multiple Covariates 
and Hiltivariate Analysis of Covariance 
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1" 


Dependent Variables 


F-test 
f value 


Mean adjusted scores by qrcup 


Possible points for 
each dependent variable 


Gruip 
S.O. 


16 
e 


8 

• 


1) Woodcock -Johnson: Letter Aord identification 


.007* 


23.71 (1) 


23.60 (2) 


17.54 (3) 


16.23 (4) 


54 


9.08 


50.40 




0\ 1 1 1 a L | _ 

2) Word attack 


.001* 


8.27 (2) 


6.36 (1) 


4.28 (3) 


1.44 (4) 


26 


5.96 


21.72 


is 


3) Passage caipinehension 


.062* 


7.68 (2) 


6.47 (1) 


5.97 (3) 


4.23 (4) 


26 


4.58 


11.92 


4) Calculation 


.000* 


13.43 (2) 


12.90 (1) 


8.13 (3) 


6.45 (4) 


42 


6.42 


15.14 


ii 


5) Applied problems 


.076* 


17.80 (1) 


15.94 (2) 


13.18 (3) 


11.18 (4) 


49 


8.61 


44.84 


1 1 


6) Dictation 


ruff a 

.065* 


11.95 (2) 


10.35 (1) 


8.32 (3) 


6.86 (4) 


40 


6.82 


29.72 




7) Proofing 


.083* 


4.08 (2) 


3.93 (1) 


2.76 (3) 


1.18 (4) 


29 


3.97 


10.09 




8) Peabody Picture Vocabulary Test: Raw score 


1 1 Ca 

.115* 


63.34 (1) 


54.76 (2) 


49.65 (4) 


48.47 (3) 


175 


21.97 


335.68 




9) Standard score equivalent 


.073* 


52.07 (1) 


44.62 (2) 


37.11 (3) 


35.81 (4) 


160 


21.35 


321.82 




10) Mental age 


.120* 


67.71 (1) 


62.56 (2) 


54.02 (4) 


53.88 (3) 


175 


21.99 


333.83 




11 % Tan 

11) TACL 


.146* 


80.60 (1) 


77.69 (2) 


72.62 (3) 


71.36 (4) 


101 


14.84 


137.08 




12) EOwPVT (Gardner) 


.012* 


62.91 (2) 


61.24 (1) 


51.54 (4) 


50.71 (3) 


110 


16.51 


167.05 


i§ 


13) Ccmrunlcatlon Inventory 


.065* 


36.24 (1) 


33.78 (3) 


33.19 (2) 


29.91 (4) 


40 


6.79 


30.24 


14) Teacher Rating of Comunlcation Skills 


.149* 


3.97 (1) 


3.48 (2) 


3.46 (3) 


3.05 (4) 


5 


1.07 


.91 


ti a| 


lb) Arizona Articulation: Raw Score 


.018* 


66.12 (1) 


65.07 (2) 


58.46 (3) 


43.44 (4) 


100 


29.19 


381.30 


|p 


16) Consonant Error 


.309 


32.43 (4) 


26.24 (1) 


25.23 (3) 


24.24 (2) 


54.5 


17.99 


170.82 


17) DSS: Mean Length of Utterance 


.485 


6.81 (2) 


6.23 (4) 


6.21 (1) 


5.45 (3) 


Unlimited 8 


3.23 


7.66 


§ M 


18) Raw Score 


.010* 


8.14 (1) 


5.83 (2) 


4.91 (3) 


3.53 (4) 


14 


3.99 


11.15 




1 £\\ T 1 II 1 Ail II 

19) Tiim Hearing Aid Worn 


.000* 


3.85 (2) 


3.72 (1) 


2.98 (3) 


2.42 (4) 


A lie. irvw «uj i<i<m 

h uo~\\Xih or aula's 

, .Hiking tars) .... 


1.00 


.58 


20) X of Child's Complication Understood by Family 


.064* 


2.69 (4) 


2.22 (3) 


2.04 (2) 


1.83 (1) 


4 (0-24X) 


.94 


.58 




21) X of Chi Id 1 s Comunlcation Understood by Non-Family 


.002* 


3.96 (4) 


3.38 (3) 


2.88 (2) 


2.52 (1) 


4 (0-24X) 


1.17 


.91 




22) X of Family Comunlcation Understood by Child 


.138 


2.53 (4) 


2.52 (3) 


2.09 (2) 


1.91 (1) 


4 (Q-?4X) 


.92 


.73 




23) X of Non-Family Comunlcation Understood by Chi Id 


.002* 


3.83 (4) 


3.82 (3) 


2.95 (2) 


2.43 (1) 


4 (0-24X) 


1.26 


1.27 




fti \ W *i /» i Li *Al_ #*1 1 1J 

24) X Tire Comunlcating with Child 


.844 


3.55 (3) 


3.52 (4) 


3.45 (2) 


3.28 (1) 


4 (more than 2 hours) 


.86 


.66 




rv* v n » ^ _ a. a a. a. i a . j _ i» * «r l i 

25) Parent Attitude Scale: Total 


.468 


106.63 (1) 


98.23 (3) 


98.01 (4) 


96.35 12) 


128 


16.61 


253.55 


-4 r- 


26) Reactions to Outside Help 


.440 


22.81 (1) 


21.84 (4) 


21.06 (2) 


20.44 (3) 


28 


4.83 


20.33 


iL. 


27) Anxiety/Guilt 


.402 


23.02 (1) 


22.91 (4) 


21.37 (2) 


21.22 (3) 


28 


4.26 


17.15 


Oft V A A _ .« 

28) Acceptance 


.319 


59.75 (1) 


66.58 (3) 


53.81 12) 


53.29 (4) 


72 


9.43 


83.39 


& Rl 

s • 

i & 


c^/ nedQaw-f.ef wd 1 1 . social flojUST«iS)l 


nil + 


75.58 (1) 


66.67 (2) 


65.65 (3) 


62.97 (4) 


92 


13.37 


124.49 


30) Self- linage 


Wa 

.135* 


71.74 (1) 


63.93 ( 3) 


66.25 (2) 


62.99 ( 4) 


92 


11.83 


106.80 


"ii \ r\ A 111 .4 .. A 

31) Eirotlonal Adjustntnt 


.313 


44.36 (1) 


42.88 (2) 


40.97 (3) 


39.66 (4) 


62 


7.53 


44.44 


32) Tire Spent Reading 


.409 


2.17 (2) 


2.07 (4) 


2.05 (3) 


1.67 (1) 


4 (nore than 2 hours) 


.83 


.73 


bj it 


33) Solitary Play 


AM 

.223 


41.9? (4) 


28.85 (2) 


28.12 (3) 


13.23 (1) 


Hiijt (aolJtary pmy 

vn. prup piny 


27.37 


699.69 




34) fiirber of Friends 


.265 


8.48 (4) 


6.46 (1) 


5.05 (3) 


2.21 (2) 


_ UaiiriKcrl 


7.91 


63.42 


i| 


35) Attitude Towards School 


.696 


1*42 (2) 


1.31 (3) 


1.30 (4) 


1.22 (1) 


3 (worse ti»n moot) 


.49 


.21 




36) Rating of Child's Bdwvior 


.093* 


2.46 (1) 


2.19 (3) 


2.11 (4) 


1.91 (2) 


1 (txit.tcr Uiin averfw) 


.57 


.32 



^Unlimited but sentence length of 12 considered very long for child 



of this age. 
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groups, statistically significant group differences exist for three of the 
four dependent variable categories. These dependent variable category 
differences confirm the existence of overall group mean differences and the 
fact that individual dependent variable differences exist within a 
category. 

Analyses of Specific Group Mean Differences 

Multiple comparison procedures . In order to determine which specific 
group mean differences contributed to the overall group mean differences, 
multiple t-tests were performed on all pair-wise contrasts, and planned 
orthogonal contrasts were performed on group combination contrasts. Results 
of these analyses are in Table 4.5 on the next page. All f and t values that 
are statistically significant at«C* .1 level are noted with asterisks. 
Negative t-values tor variables 18-21 indicate better performance for the 
first group in the pair-wise comparison since higher scores on these variables 
are indicative of poorer performance. Negative values for any other t-scores 
indicate better performance by the second group in the pair-wise contrast. 

Discussion . Eighty percent of all £ and t, values favor groups 1 and/or 2 
when compared to groups 3 and/or 4 at levels of statistical significance. 
This can be seen more specifically in a summary of the percent of f and t 
values that favor the home intervention children in groups 1 and/or 2. 



Table 4.6 



Percent of f and t Values Favoring 
Groups 1 and/or 2 



Comparisons 



% of statistically significant 
f and t, values favoring 
groups 1 and /or 2 



values favoring 
groups 1 and/or 2 



% of all f and t 



1 vs. 4 

1 and 2 vs. 4 

1 and 2 vs. 3 and 4 

1 and 2 vs. 3 



100% 
95% 
92% 
79% 
75% 
71% 



100% 
100% 
100% 
100% 

96% 
100% 

92% 



2 vs. 4 

1 vs. 3 

2 vs. 3 



46% 
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Table 4.5 
Results of Multiple Coiprlscn Procedires 

HjlUpIo - T Tests; (critical t • 1.60) 



Planned Orthogonal Contrasts : 
(critical f » 2.77) 



Dcpcnrlcnt VarlAlcs 


Grap 
i vs. 2 


Group 
1 vs. 3 


Grap 
1 vs. 4 


Grap 
2 vs. 3 


Group 
2 vs. 4 


Grap 
3 vs. 4 


Grap 112 
vs. 3 I 4 


Grap 1. & 
2 vs. 3 


Group 1 & 
2 vs. 4 


1) Mnk-nr.knkilnson: LetlerAord Identification 


.05 


2.95* 


3.56* 


2.90* 


3.3)* 


.60 ' 


21.24* 


17.46* 


25.29* 


i') Mnlcnck-Jblnsm: W*d attack 


-1.39 


1.52 


3.59* 


2.91* 


4.99* 


2.07* 


21.50* 


9.90* 


37.39* 


3) Vim tack -dohnson: Passage coiprebcnslon 


-1.19 


.49 


2.20* 


'1.60* 


3.38* 


1.71* 


7.70* 


2.41 


15.90* 


<l) Wntack-Jolmnn: Calculation 


-.46 


4.14* 


5.61* 


4.6* 


6.07* 


1.47 


53.55* 


39.24* 


70.00* 


5) Hx icock-Jrilroon: Spiled problems 


.91 


2.35* 


3.36* 


1.40 


2.42* 


1.02 


11.54* 


7.14* 


16.99* 


6) Mvik'or.k -Johnson: Dictation 


-.99 


1.26 


2.17* 


2.25* 


U6» 


.91 


10.03* 


6.34* 


14.57* 


/) Myitack-Julfison: Proofing 


-.16 


1.24 


2.93* 


1.40 


3.09* 


1.60* 


9.66* 


3.61* 


10.61* 


fl) 1'c.rfndy Picture Vocabulary Test: Raw score 


1.59 


2.75* 


2.54* 


1.16 


.95 


-.22 


7.00* 


7.05* 


6.19* 
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These results Indicate that the hearing impaired children in this study 
who received home intervention perform better on the majority of dependent 
variables than children who did not receive home intervention. 

When performing multiple comparison procedures on group 1 vs. 2 (early 
vs. late) and group 3 vs. 4 (no home intervention/preschool vs. no home 
intervention/no preschool), the majority of ^-values were not statistically 
significant. This indicates that early vs. late and preschool vs. no 
preschool effects are largely nondifferential for children In this study. 

When considering the percent of statistically significant group 
differences in dependent variable categories, early intervention children 
perform better on communication/language skills while late intervention 
children performed better on achievement tests. This may suggest that early 
home Intervention more directly affects later language. 

Analyses of Educational Significance 

Effect size analysis . In order to determine the existence of education- 
ally significant differences of specific group means, effect sizes were 
obtained for all comparisons discussed in the previous section. These results 
are shown below 1n Table 4.7. Effect sizes of larger than .5 are considered 
to be important from an educational standpoint and are noted with asterisks. 

It should be noted that effect sizes for all 36 dependent variables are 
given below since even though statistically significant overall group 
differences do not exist for 12 of these dependent variables., there is still 
possibility for there to be educationally significant group differences for 
these variables (and vice versa). 
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For variables 18-21, 33, and 35, negative effect sizes still indicate 
better performance by the first group in the comparison since higher scores on 
these variables are indicative of poorer performance. 

Discussion . When considering the number of educationally significant 
effect sizes compared to statistically significant f and £ values, it is 
apparent that there are more statistically significant f and t_ values for the 
24 dependent variables that show statistically significant overall group 
differences. However, educationally significant effect sizes exist for the 
majority of the 24 dependent variables in the majority of group comparisons. 
These observations are summarized below in Table 4.8. 



Table 4.8 

Number of Statistically Significant f and J: Values 
vs. Educationally Significant E"5" Values 



No. of statistically significant No. of educationally 
Comparisons f or t_ values significant ES values 
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vs. 


3 


19 


(f) 


11 


Group 1 and 


2 


vs. 
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There are more educationally significant m ' Terences for dependent 
variables that were previously determined to 1 statistically significantly 
different among groups than for those dependent variables that were not. 
For those dependent variables that were previously determined not to be 
statistically significantly different aniong groups, H% (15 out of 108) of the 
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effect sizes are educationally significant. Twelve of these 15 effect sizes 
favor the following groups: home, intervention over no home intervention, 
early over late home intervention, and preschool over no preschool. 

Comparisons that were previously determined to be statistically 
significantly different among groups consistently favor the first group in the 
comparison at a levol of educational significance. In the 1 vs. 4, 1 vs. 3, 2 
vs. 4, 1 and 2 vs. 4, and 1 and 2 vs. 3 and 4 comparisons, the majority of the 
effect sizes favor the children in home intervention groups. 

Home intervention children are again favored in the group 1 and 2 vs. 3 
contrast, where all groups are equated on preschool. The positive long-term 
effects of home intervention vs. no home intervention on hearing impaired 
children are suggested in these results. 

Implications and Recommendations For Future Research 

In this section, research findings will be presented, and then 
implications of each finding will be listed. In a statistical sense, these 
implications are true only to the extent that external validity exists in the 
study. Measures taken to control threats to external validity were outlined 
in Table 4.1. 

Finding 

Hearing impaired children in this study who receive home intervention 
earlier in their lives performed better than children who did not receive home 
intervention on the majority of dependent variables in the areas of language, 
academic achievement, and psycho-social behavior. 

Implications 

1. Home intervention promotes the development of basic skills that 
enhance later language, academic, and psycho-social functioning. 
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Hearing impaired children who receive home intervention services may 
be able to function better at home and at school than children who do 
not receive home intervention services. Home intervention children 
may be better able to interact with family, peers, and teachers as 
evidenced by their superior communicatjon and psycho-social 
competencies. They may also be able to function better academically 
in school since academic achievement skills are improved. 

2. Parents and siblings who receive home intervention are apparently 
able to communicate more effectively with the hearing impaired child 
than parents and siblings who do not receive home intervention, since 
the child's communication and interactive skills are improved. 

3. Teachers and professionals who deal with home intervention children 
may also be able to more effectively interact with these children 
because of improved communication, academic, and psycho-social 

ski lis. 

In addition, they may spend more time on the promotion of subject 
matter skills instead of language-related skills (contrary to the 
typical educational programming of hearing impaired children who 
enter school without strong language bases). Also, teacher time 
spent on management of hearing aid, management of problem behavior, 
and explanation of school tasks and protocol may be reduced with home 
intervention chi ldren. . 

Finding 

Children in this study who received early home intervention performed 
better than late intervention children on some of the dependent variables. 
Early intervention children performed better on communication/language skills 
in relationship to academic skills, 
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Imp! i cations 

1. The success of home intervention is dependent on many factors, 
including timing, duration, and intensity of intervention 
efforts. 

F i nd i ng ' 

Hearing impaired children in this study who received preschool, but not 
home intervention services performed better than children who did not receive 
preschool or home intervention on certain dependent variables. 

Imp 1 i cat ions 

1. The impact of home intervention may be strengthened by the provision 
of other services, such as preschool. The provision of home 
intervention and preschool may result in greater communication, 
academic, and psycho-social benefits for the child than the provision 
of either service (especially preschool) alone. 

Finding 

Many factors, particularly child and parent characteristics, account for 
the majority of the variance of the dependent variables if not controlled in 
the analyses. 

Implications 

1. Effectiveness of home intervention is dependent on many factors. In 
this study, it was determined that some of the most important factors 
contributing to the Jong-term effect of home intervention were: 
Child age, hearing loss, parental index of social position, existence 
and severity of other handicaps, age of mother, and number of middle 
ear infections. Of course, there are others. Since it was not 
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within the scope of this research project to specifically study what 
and how child and parent characteristics contribute to later success, 
a complete description of their effects is not possible. 
However, from this study and others (Gage & Berliner, 1979), one 
important implication that emerges is the necessity of optimizing factors that 
might contribute to later child success, such as (a) reducing middle ear 
ear infections, (b) mitigating effects of other handicaps, (c) improving SES, 
(d) improving such parental characteristics as time interacting with child, 
aspiration for child achievement, emphasis of language development, provision 
of learning opportunities in the home, and acceptance of the child. It should 
be noted that the long-term impact of home intervention may be dependent on 
the nature of the intervention. The SKI*HI model (which directly habilitates 
communication in the hearing impaired child) may have more direct effects on 
later language than academic skills. Or perhaps the nature of any home 
intervention program is such that impact will be greater on later language vs. 
academic skills since many skills requiring habi 1 i tat ion are age specific 
(language skills precede academic skills). In either case, the nature of the 
intervention may have an effect on later child performance. 

Finding 

Many dependent variables did not reveal statistically significant 
differences between research groups. 

Imp! ications 

i. It is impossible to determine with precision why group difference did 
not exist for a few' of the dependent variables. However, some 
possible reasons for the no-difference findings are: 
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a. Problems with validity and reliability could have existed for 
measures used in this study, particularly the parent attitude 
scale, some items in the parent questionnaire, and the DSS-MLU. 

b. Intervention could have provided effective services during its 
tenure but could not completely buffer families from the adverse 
effects of hearing impairment during later periods of 
developmental crisis. 

c. The advances made by intervention children during treatment could 
have been reduced or reversed when these children were later 
grouped in schools with no intervention children. 

Whatever the reasons for no difference, it becomes apparent that further 
research is needed to see if some dependent variable differences really do not 
exist and, if so, for what reasons, and to develop intervention strategies 
that more successfully remediates the dependent variable skills. 

While this study has resulted in some useful findings in regards to the 
long-term effects of intervention on hearirg impaired children, much research 
remains to be done: 

1. Continued longitudinal data collection on the intervention children 
involved in this study are needed. 

2. Studies are needed on the impact of home intervention on child and 
parent competencies not included in this study. 

3. Studies are also needed on the impact of home intervention on areas 
other than child and parent competencies, such as sibling attitudes, 
family/marital structures, extended family involvement, and community 
awareness. 

4. Further studies are needed to replicate the Clark and Covert (1979) 
study on short-term effects of home intervention and the effect of > 
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vs. late home intervention on hearing impaired children. 
Cost effectiveness studies are needed which would involve: 

a. identification of all treatment alternatives, 

b. description of all components necessary for administration of 
treatment alternatives, 

c. assignment of cost values to all resources, 

d. analysis of cost outlay in terms of child and parent progress. 
Studies need to be done isolating parent, child, and environmental 
factors that are highly related to later child success and that are 
remediable, such as parent-child interactive styles, parent 
motivation and aspiration for child's achievement, home environments 
arranged for learning, parent encouragement of child's autonomy, and 
parent acceptance of the handicapped child. 
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As part of the EIRI proposal, a dissemination plan was developed and 
summarized in the proposal. This plan included 11 major components. The 
dissemination plan 1s reproduced on the next page as Table 5..'. From 
the table, a description of dissemination activities in each area is given. 
Activity One - Utilizing the University affiliated network 

The Institute has utilized this network infrequently during Year #1. 
Contacts have been made with the network but EIRI staff have mostly 
repsonded to Information requests. As research findings accumulate, this 
network will be utilized mora extensively as a dissemination outlet. 
Activity Two - Utilizing existing training 
activities of the Exception. hi Id Center 

The Institute has utilized the existing training activities extensively 
as a dissemination vehicle. EIRI staff have made presentations to training 
groups and have conducted meta-analysis and cost-effectiveness workshops for 
these training groups. 
Activity Three - Publications 

A total of 23 publications, conference presentations and workshops were 
disseminated during Year #1. Eighteen other publications and papers are in 
preparation. A complete list of these efforts appears as Table 5.2- It 
should be noted that there is some duplication of papers in certain areas. 
Those titles listed under "submitted for review" are currently being 
reviewed by members of the EJRI publications review council. 
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Table 5,1 



Summary of EIRI Dissemination Plan 



"AcTTvTfy" 



1. 



Capabilities of ECC as one 
of the nationwide networks 
of University Affiliated 
Programs for the 
Developmental ly Disabled 



2. Existing ECC training 

activities separate from EIRI 



3. Publications 



4. Conference presentations^ and 
Information displays 



TeYcrTpOon 



The ECC Is one of a network of 47 University Affiliated Facilities (IJAFs) throuqhout the United States. One of 
the primary missions of UAFs Is the dissemination of Information about providing effective services to 
handicapped people. Consequently, ECC staff are already heavily Involved In numerous organizations and activities 
which will contribute to the dissemination of Information from the EIRI . For example, ECC staff have regular 
contact and/or serve on Councils for the Developmental ly Disabled In Utah, Idaho and Wyoming; the ECC has 
sponsored and continues to provide support services to two satellite UAFs In Montana and on' the Navajo reservation 
In Arizona; the ECC board of directors Includes representation from the Utah Division of Health, local school 
districts related University departments, and parents; the ECC advisory board Includes people from a five state 
area who are associated with the provision of services to handicapped Individuals; and, copies of the ECC Annual 
Report are distributed to over 150 people throughout the United States. In all of these contacts, Information 
about the EIRI, Its findings and products, would be disseminated without any cost to the EIRI. 

A second primary thrust of the Exceptional Child Center Is training of people responsible for providing services 
to handicapped Individuals. These training activities Include both preservlce and Inservlce In a wide variety of 
areas. During 1980-81 ECC staff provided 3248 student credit hours of University coursework and practica, 47 
workshops Involving §9M person contact hours and spent 1773 days In various field activities throughout thT 
Western United States. Virtually all of these training activities also serve a dissemination function, many of 
which are directly relevant to the provision of services to young handicapped children. Findings and products 
from the EIRI can be disseminated through these training activities with no cost to EIRI. Specific examples of 
the types of projects applicable for such dissemination can be seen In the Technical Section of the ECC 80-81 
Annual Report In Appendix E. 

Findings and Information about products developed by the EIRI will be disseminated through a variety of 
professional outlets. Each research thrust will generate one or more articles to be submitted to professional 
refereed journals; all applicable products, technical reports, and research sumnarles will be filed with ERIC; 
reports of major research thrusts will be prepared as publications as books, and Information about EIRI and Its 
findings will be released to various professional and parent newsletters. Two of thes$ newsletters are published 
by the Exceptional Child Center: the Exceptional News (a newsletter for provider* with circulation of 2,200) and 
the Parent Newslett er (a newsletter for parents of handicapped children wit a circulation of 700) will regularly 
carry information about the activities of EIRI. Officials of the Special Educator , a newsletter published by the 
Utah Comprehensive System of Personnel Development consortium and distributed to all special education teachers In 
Utah, have also agreed to carry a regular quarterly column from EIRI (see letter of support). Other outlets such 
as the National Association for Retarded Citizens, the Technical Assistance Development System (TAOS) Newsl etter 
and other state newsletters will also be approached about dissemination opportunities. 

EIRI findings and Information about products will be disseminated regularly through professional conferences and 
meeting information about products will regularly be disseminated through professional conferences and meetings. 
During the first year (1902-83) no formal papers will be presented at such national meetings because of deadlines 
for submission. However, the ECC regularly displays products and information at such conventions. During 
1982-83, the Institute will do two such exhibits, one at CEC's annual meeting In Dallas and the second at the AAMtl 
annual meeting in Detroit. Displays will distribute Information riout the mission, activities, and findings of 
EIRI. In subsequent years of the Institute, numerous professional presentations will be made. The Institute will 
fund travel and per dtein for four people to conventions each year, but many more presentations will be made with 
travel costs being covered by other ECC funds. For example, during the last two years members of the proposed 
EIRI management team have averaged 7.3 professional presentations per yaar at national meetings. Graduate 
students and research assistants wiTT~also participate In these presentations. 
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Table 5.1 (continued) 



ActTvU y 



5. Professions In conjunction 
with professional meetings 



6. Summer conferences and 
workshops at Utah State 
University 



7. Training Sessions in 

conjunction wi^h research 
projects 



8. Newspaper and television 
coverage 



9. Placement of trainees 



10 
f 



0. Annual distribution of key 
indings and products 



II, Attendance at semiannual 
Institute meetings 



"OescrTpti"on" 



Beoinninq in year 12 of the Institute, at least one research training pressesion will be held In conjunction with 
a national professional meeting such as AERA, CEC, or AAMO. All of the senior level staff on the Institute have 
experience conducting such presessions at either AERA, CEC, or AAMO. Such presessions provide opportunity for 
in-depth training of national audiences. 

Each year for the past five years Utah State University's Department of Special Education In conjunction with the 
Exceptional Child Center has sponsored a Special Education Interventions Conference, which is attended by 
approximately 100 people from throughout the western United States. The Head of the Department of Special 
Education has agreed to have at least one session of this Interventions Conference sponsored by EIRI each year 
(see letter of support). Costs for major recruitment and publicity for this conference would not be charged to 
the EIRI budget. In addition, Utah State University's Lifespan Learning Center, a division of Continuing 
Education, sponsors numerous workshops each summer on a variety of topics. The head of Continuing Education has 
also aqreed to have EIRI participate in this program (see letter of support). The facilities of the recently 
completed Lifespan Learninq Complex and Residence Hall on the campus of Utah State University provide particularly 
attractive facilities for such conferences. 

As noted earlier, intensive training will be provided to project staff in meta-analysis and cost effectiveness 
analysis during year one. Participation in these workshops will be opened up to other interested people at the 
University and throughout the state and region for the cost of materials (and tuition should they desire credit). 
It is anticipated at least 15 additional people outside the staff will attend both of these workshops. 

Regional newspaper and television stations routinely cover significant activities of the Exceptional Child Center 
(for example, a recent article concerning the Multiagency Program for Preschoo ers MAPPS), an early in ervention 
proqrain developed at the ECC, is contained in Appendix E). Staff from the EIRI will work with USU public 
information specialists to actively seek out this type of information coverage. 

Some of the most effective and long-term dissemination of Institute findings and products will ^cur through the 
placement of graduate students and research assistants trained by the Inst tute. The Exceptional Child Cen er has 
already established an excellent track record In this area. A number of students *o have participated In the 
Interdisciplinary training program of the Exceptional Child Center are working In areas directly re ated to the 
provision of services to preschool handicapped children. Emphasis on the person's nter est in working w th 
preschool children will be used In recruiting graduate and research assistants, so It Is anticipated that this 
excellent track record will be even better for students trained In conjunction with EIRI. 

As a part of Its dissemination efforts, the EIRI will develop a brief executive sumnary of It's activities and 
accomplishments for each year, Including a listing of publications, products, and technical reports which will be 
disseminated free of charge to a broad audience of people and organizations nterested in early intervention with 
handicapped children (approximately ZOO people). This distribution list wi 1 be compiled by ident fying one 
person in each state (either education, social services, or health) who is in a key position relative to the 
provision of early intervention services in that state, and asking each to nominate one other person in their 
state who ought to be Included. HCEEP project directors and former project directors and university based 
researchers with demonstrated interest in the area will also be Included. 

At leist two people from EIRI staff will attend the semiannual Institute meetings in Washington, D.C. and 
participate fully in its proceedings. 
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Activity Four - Conference presentations 
and information displays 

The EIRI staff delivered 14 conference presentations during Year #1. 
These papers and presentations appeared in Table 5.2. Information displays 
were prepared for the DEC/HCEEP conference. 
Activity Five - Pre-sessions at professional meetings 

EIRI staff conducted three pre-sessions at professional conferences. 
These pre-sessions encompassed meta-analysis training and cost-effectiveness 
training. Titles of the sessions were given in Table 5.2. 
Activity Six - Summer conferences and workshops 

EIRI staff conducted a workshop as part of the Utah State University 
summer session. The workshop provided interested practitioner researchers 
with information concerning institute activities. Twenty people from a four 
state area were included in the workshop. 
Activity Seven - Training sessions in 
conjunction with ongoing research 

The Institute conducted both meta-analysis and cost-effectiveness 
training workshops for Institute staff and interested practitioners and 
researchers from the intermountain area. 
Activity Eight - Newspaper and television coverage 

Announcements concerning the Institute and its work scope appeared in 
area media during the year. One regional television station reported EIRI 
activities. This dissemination activity will assume a higher priority as 
institute findings become available. 
Activity Nine - Placement of trainees 

Trainees working with EIRI during Year #1 have been placed in Texas, 
Idaho and Maryland. These placements will increase as trainees finish 
degree programs. 
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Table 5.2 

EARLY INTERVENTION RESEARCH INSTITUTE 
Publications, Professional Papers and Presentations 



iS-i 



Publications 

Casto, G., White, K., ft Taylor, C. An early Intervention research Institute: 
Studies of the efficacy and cost effectiveness of early Intervention at 
Utah State. Journal of the Division for Early Childhood . 1983, 5-1/. 

Submitted for Review 

Bush, D. t I White, K. The effectiveness of early Intervention: A 
summary of previous reviewers' conclusions. 

Casto, G. t iCIarkson, D. Selecting outcome measures In early Intervention. 

Casto, G. t Shearer, D./t ,Cavaleri t T. Critical Issues In early 
Intervention: A view from the field. 

Hills, T. t Shearer, 0., ft Casto, G. Research Into practice: Procedures for 
the effective dissemination of research findings. 

In Preparation 

A cost-effectiveness study of half-day versus full-day preschool programs 
for the handicapped. 

Policy Implications of a cost-effectiveness analysis of half-day versus 
full -day preschool programs for the handicapped. 

3. A critical review of cost-effectiveness analysis In the provision of 
human services. 

4. The costs of preschool education for the handicapped. 

5. Conducting cost-effectiveness analyses in special education (addressed to 
practitioners). 

6. Conducting cost -effect 1ven t ss analyses In special education (addressed to 
researchers). 

7. A critique of an economic analysis of the Ypsllanti Perry Preschool 
Project. 

8. Valuing parent contributions In preschool programs for the handicapped. 

9. A manual fur conducting cost-eff -^ilveness studies in special education. 



10. 



A critique of the Colorado cost-effectiveness study: Effectiveness of 
early special education for handicapped children. 



In Preparation (continued) 

11. A Meta-analysis of the early Intervention research literature (monograph 
length). 

12. A meta-analysis of the early Intervention research literature (journal 
art 1c le— researchers) • 

13. A meta-analysis of the early Intervention research literature (journal 
article— practitioners). 

14. Conclusions from an analysis of previous reviews of early Intervention. 

15. Conducting high quality Integrative reviews. 

16. A critical analysis of the Milwaukee Project. 

17. Early versus late preschool Intervention for hearing Impaired children. 

18. The effectiveness of home-based and center-based Intervention program* 
for preschool hearing Impaired children. 

Professional Papers and Presentations 

Bush, D. W., ft White. K. R* The efficacy of ear |y Intervention: What can be 
learned from previous reviews of t he literature? Paper presented at the 
annual meeting of the kocky Mountain Psychological Association, Snowbird, 
Utah, April 1983. 

Casto, G. The efficacy of early Intervention: Conclusions from previous 
review s of the liter ? ire. Pi^er presented at the Fourth Annual Hon tan a 
lywposhim on Early F .iTfion and the Exceptional Child, Billings, Montana, 
April 1983. 

Casto, G., ft Casto, Y. Intervening with high risk Infant s. Paper presented 
at the Fourth Annual Montana Symposium on iarly Education and the 
Exceptional Child, Billings, Montana, April 1983. 

Casto, G., t Clarkson, 0. Selecting outcome measures In early Interven tion. 
Paper presented at tht Fourth Annual Montana Synpos turn on Early Education 
and the Exceptional Child, Billings, Montana, April 1983 . 

Casto, G. , ft Shearer, 0. Previous reviewers 1 conclusions about the 
effectiveness of early Interv ention. Paper presented at the Montana 
Symposium for Severe/Profound, dMIlngs, Montana t February 1983. £| 

ro 

Casto, G., Shearer, 0., ft Cavalerl, T. Critical Issues In early 

Intervention : A view fro m the field . Paper presented at the annual 
meeting of the ToHylftunl^nTsycho logical Association, Snowbird, Utah, 
April 1983 and the Fourth nual Montana Symposium on Early Education aid Q 
the Exceptional Child, Billings, Montana, April 1983. |0 J 
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Table 5.2 (continued) 



Professional Papers and Presentations (continued) 

Mills, T., Shearer, 0., t Casto, G. Re search Into practice: Procedures for 
the e ffective dissemination of research findings . Paper presented at the 
annual meeting of the Rocky Mountain Psychological Association, Snowbird, 
Utah, April 1983. 



Pez/ino, J., I Taylor, C. A critical review: Cost-effectiveness analysis In 
hum an service re search. Paper presented at the Fourth Annual Montana 
Symposium on Early Education and the Exceptional Child, Billings, Montana, 
April 1983 and the annual meeting of the Rocky Mountain Psychological 
Association, Snowbird, Utah, April 1983. 

Shearer, 0. Early Intervention Research I nstitute . Present©'' to Research In 
Action 11, Lubbock, Texas, February 1981^ 

Taylor, C, & Pezzlno, J, How to analyze the cost-effectiveness of preschool 
programs. Invited presentation to Board of Directors, Northwest ChlT3 
Development Center, Wyoming, April 1983. 

Walker, K. How t o value parent time: A cost or a benefit? Piper presented 
at the Fourth Annual Montana Symposium on Early Education and the 
Exceptional Child, Billings, Montana, April 1983. 

Walker, K, Making d ollars and sense of cost-effectiveness procedures . Paper 
presented at the Fourth Annual Montana Symposium on Early Education and 
the Exceptional Child, Billings, Montana, April 1983. 

White, K, , & Casto, 6. The Integrati on of completed research; Procedures 
and st ate of the art . Paper presented at the Fourth Annual Montana 
Symposium on Early Education and the Exceptional Child, Billings, Montana, 
April 1983. 

White, K. R, , Goodrich, 6., & Taylor, C. The integration of completed 
research; Standards for high quality work. A paper presented at the 
annuaT~moetlng of the fioclcy mountain Psychological Association, Snowbird, 
Utah, April 1983. 



Workshops (continued) 

White, K. R. , & Bush, 0, W. Meta-analysi s procedures for Integrating 
research . Workshop presented at the annual meeting of the Rocky ¥ 
Psychological Association, Snowbird, Utah, April 1983. 



mntain 



White, K. R. Meta-analysis: Integrating completed research . Presented at 
the Early Intervention Research Institute's Workshop, "Efficacy and Cost 
Analysis in Early Intervention: Research Into Practice 11 , Logan, Utah, 
June 1983. 



Workshops 

Taylor, C, Pe**1no, J., Walker, K. , & Cavalerl, T. Cost effec tiveness 
analysis in so ci al program evaluat ion. Workshop presented at tfie "Fourth 
finnuaflfontdna~Sympo$1um on EarlyTducat ion and the Exceptional Child, 
Billings, Montana, April 1983 and the Annual Meeting of the Rocky Mountain 
Psychological Association, Snowbird, Utah, April 1983. 

Taylor, C. Cos t-effectiveness analysis of early Intervention . Presented at 
the Ear1y~Tnterveniion Research" InsflTuFe ' s Summer Workshop, "Efficacy and 
Cost Analysis In Early Intervention: Research Into Practice", Logan, 
Utah, June 1903. 
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Activity Ten - Annual distribution of key findings 

An executive summary of Year. #1 findings is currently being prepared. 
The summary will be distributed extensively utilizing the E1RI dissemination 
file. Copies of the annual report will also be made available to a more 
restricted audience. Technical papers will be published in early education 
journals. 

Activity Eleven - Attendance at semi-annual meetings 

The three primary staff members of the Institute have participated in 
both meetings conducted to date. 
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CHAPTER VI 
ADVISORY COMMITTEE 
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Advisory groups represent a substantial investment. To enhance the 
value of the advisory functions, the Utah State University Early Interven- 
tion Research Institute proposed an advisory group configuration which was 
unusual in terms of selection and function. The primary ways in which the 
EIRI Advisory Committee differs from typical advisory committees are out- 
lined below. 

1. The main advisory committee consists of 10 people— six who are 
primarily methodologists and/or early intervention content experts; 
and four who primarily represent constituency groups. To select 
people representing various constituency groups, national organiza- 
tions were contacted and asked for a nominee for the advisory 
committee. This selection procedure provided a more direct link in 
disseminating information to constituent groups and should result 
in advisory committee members being more sensitive to the views and 
concerns of the groups they represent. 

2. Structured assignments with clearly defined outcomes were given to 
each member of the advisory committee to ensure that they would 
give effective feedback about the Institute's direction. 

3. A second group of approximately 50 people were identified to serve 
as "field reviewers". These people will not attend advisory 
committee meetings but have agreed to respond to written 
questionnaires concerning various EIRI functions. This feedback 
provides broad inputfrom the field at nominal cost. This group 
responded to three questionnaires during the year. 

The two advisory groups referred to above were structured to assist 
EIRI in three main areas. 
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1. Assure that the Institute remains responsive to the priority needs 
and concerns of the field; and that activities and procedures are 
sensitive to current issues, politics, and organizational 
arrangements. 

2. Provide structured review and criticism of EIRI plans and products 
to assist with quality control and methodological rigor. 

3. Assist in disseminating information concerning EIRI activities, 
findings, and products; and provide advice and criticism concerning 
dissemination options. 

Descriptions of the organization and tasks of the main advisory 
committee and the field reviewers during Year #1 are given below. 
Composition of Advisory Committee 

Table 6.1 provides a description of Advisory Committee members along 
with a brief summary of their experience and qualifications. 

The Year #1 advisory committee meeting was held on October 20 and 21, 
1982. The meeting was held early in the year to enable project personnel 
to receive feedback early in the project on the proposed Year #1 work scope. 
The agenda for the first meeting is reproduced on the following page. 
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EARLY INTERVENTION RESEARCH INSTITUTE 
ADVISORY COMMITTEE MEETING AGENDA 
October 20 & 21, 1982 



Wednesday - October 20 

12:00 - 1:30 pm Lunch 

Introduction of EIRI Staff and Advisory Committee 

1:30 pm- 2:15 pm Tour of Exceptional Chi Id Center Facll Itles and 
Programs 

2:15 pm - 3:00 pm Brief Overview of Early Intervention Projects 

Associated with EIRI (MAPPS, SKI*HI, Portage, CHIPP) 

3:15 pm - 5:00 pm General Work Session on Issues/Problems/ Improvements 
1n Proposed W^rH s<-nr?o 

Thursday - Oc truer 21 

3:30 am - 12:00 Separate intj Task Groups to Address Specific Issues 

Program Design Task Methodological Task Group 

M.»rle Karnes ' Gene Glass 

Peter Fanning Craig Ramey 

Jessica Strout Hank Levin 

Karl White 
C1e Taylor 

Glendon Casto Ann Austin 

Oavld Shearer Susan Watklns 

12:00 - 1:00 pm Lunch 

1:00 pm - 3:15 pm Continuation of Task Group Work 
3:15 pm - 3:30 pm Break 

3:30 om - 4:30 pm Presentation and Oiscusslon of Issues from Task Groups 
which Need Comment Discussion by Entire Committee 

4:30 pm - 5:00 pm Procedures for Follow-up, Subsequent Activities 
Next Meeting and Specific Assignments 
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Table 6.1 
Membership of EIRI Advisory Committee 








Gone V Glass, Ph.D. 


Professor of Education 

L Dcwrhnlnnw an/4 P n - 
■ r»/t.nuiuy/ inu tu* 

director of Laboratory 
of Educational Research 
University of Colorado 


Dr. Glass Is one of the country's leading research methodologlsts and the originator of "meta-analysis 11 tech- 

iiii|uca. nc nfla written ui cut iiu 7 wuuni \ mil iuu my uiic ui tne >uii wiuc 17 uacu iiaiiiiiii icaii anu ■ uuun 

on meta-analysis) and over ISO publications. He Is a former president of the American Educational Research 
Association and has served as the editor of Review of Educational Research and Psychological Bulletin. He has 
served on numerous national advisory committees including the Technical Advisory Committee to the National 
Assessment of Educational Progress and one for conducting a meta-analysis of Bilingual Education. His research 
has addressed numerous problems In special education. 


Henry i ouin Ph n 
ntjnr j i.evin, rn t u* 


Dmfttccn>> t\9 FrnfVAa4rc 

and Education, and 
Director of the Insti- 
tute for Research on 
Educational Finance 
and Governance, 
Stanford University 


Ur« Levin 11 pvuu#u iy tne country 1 rorewuit eutnority on cost ei rect iveneis/coit oBnin 1 anfliysii in euuca- 

t Ion. Applying his training as an economist to educational problems, he has written the seminal works on cost 
analysis In education. His publications Include 11 books and over 100 articles. His recent publications 
Include a manual for conducting cost analyses In education and several papers on cost analysis In special 
education. He Is a past president of the Evaluation Research Society, a past vice president of AERA, and 
served on the National Advisory Committee for National Program on Early Childhood Education. He directed tht 
Ford Foundation sponsored "An Economic Analysis of Education* V Vouchors" from 1970-73 and has been principal 

4 nuiC t 4 siafr ni* fni* nuir t( m4 114am n9 ni>Ala«>lc 9 vnM 10.7A-A9 

invcaii*]fliur For over #9 Million or project! from iy/o-oc. 


Craig Ramey, Ph.D. 


Professor of Psychology 
and Director of 

Dncnirrk at frha F** an If 

Koearcn at tne rrin* 
Porter Graham Child 
Development Center, 

II nf Mnrfrh farnHna 

Ui of nortn Ltroiint 


Since 1975, Dr. Ramey has directed tht Carolina Abecedarian Project and Project CARE— two projects assessing 
the longitudinal effect of early Intervention with "high risk" and developmental ly delayed children. He has 

haan af M ua with ilia rav*n14na Int ft 4 friifr a 9n v> Dacaav>/*li anH f iwl u FHns*Afr 4/ttt mH k>> nuhlichaH nuii> irl 4/* 1a* nt% 

oeen active witn tnc wironni inititute ror neseercn any cany tuucation ana nas puoiiinea over articiei on 
early Intervention and developmental psychology. 


Merle Karnes. Ph.D. 

. ■ i. 


Professor of Education, 

In*H tut* far Chi Id 
ni*ti tutu fur bin iu 

Behavior and Develop- 
ment, University of 
Illinois 


Dr. Karnes has directed numerous Early Intervention Projects with handicapped, gifted, and disadvantaged 

rh4 1/4r > an anH it nna t\9 ft" ha \*mAintt anfrhAv*4 # 4 ac in rni»i» Iru Iiim #n*> nracrtmnl rhilHran th« uae aufthnr n 9 t h a 

Lniiurvn, n'u 11 one 01 tne letniiny minorities in curriculum ror prcicnooi cniiuren. >nC wai eutnor or int 

preschool curriculum. Small Wonder, and has over 100 publications on curriculum development and parental 
participation. Currently. Dr. Karnes is Editor of the Journal of the Division of Early Childhood (CEC). She 
has served on the Advisory Com It tee for two previous technical institutes and is currently serving on the 

iHuiinnu rnwittta* #nv> tkt* AT VP Uaan 1 (lirt mat a. in a 1 uc 4 c 

aavisorjr committee ror me n*jt neeo atari mete-ana lysis. 


Peter Fanning 


Director of Special 
Education, Colorado 
Department of Education 


Mr. Fanning was nominated by the National Association of State Directors of Special Education. He Is 
currently serving as the President of that organlfation. He has served as a classroom teacher for handicapped 
children (K-12) and a public school special education administrator. 


Tal Black 


Administrator 


Tal Black Is past President of the Division of Early Childhood (DEC), a division of the Council for Excep- 
tional Children. He is also an associate director of the Technical Assistance Development System (TADS). 


Sharon Hlxon 


Classroom Teacher 


Sharon Hlxon works with a preschool cooperative in the state of Kansas. She has been active in early 
intervention for several years. 


Jessica Si' 


Parent of a handi- 
capped child 


Ms. Strout was nominated by the National Association for Retarded Children, She is the parent of a 
handicapped child (age 4-1/?) who has been In intervention programs since age 1. She has been active in ARC 
ana 11 currently cntirpenon of rrienai or tne i#ni iaren i center ooero. 


Phillip Strain 


Director, Pittsburgh 
Early Intervention 
Research Institute 


Dr. Strain directs the early intervention research Institute located at the University of Pittsburgh. He has 
conducted numerous early Intervention research projects and has published extensively in early Intervention 
areas. 


Runu Stmeonsson 


Investigator, Carolina 
Institute for Research 
on Early Intervention 
for the Handicapped 


Mr. Simeonsson directs the FAMILIES research project at the University of North Carolina. He has written 
extensively in early intervention and is the author of the Carolina Record of Infant Behavior (CRIB). 


Nina Carran 


Administrator 


Nina Carran is the director of a State Implementation grant (IQWA) which is forming a consortium of all state 
early childhood directors. 
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To receive feedback from advisory committee members in specific areas, 
a program design task group and a methodological task group were also 
constituted. These task groups and the tasks they addressed appear below. 



ADVISORY COMMITTEE TASKS 

Program Design Task Group 
(Membership: Karnes, Fanning, Strout, Black) 



Task/Questions 


Relevant 
Sections 
of Proposal 


Resources Which Will be 
Available at the Meeting 


How can we improve strategies 
for identifying and collecting 
cost analysis data? 


Pp. 38-40 


List of possible ingredients 
and strategies. 


How can we most effectively 
utilize field reviewers? 


Pp. 56-58 


List of field reviewers. 
Draft questionnaire. 


How can we develop a field 
based research network for 
replication of EIRI studies 
and other studies generated by 
meta-analysis? 


Pp. 1. 2, 
23, 24, 25, 
48-53 


List of examples of agencies. 
List of suggested strategies. 


How can we improve dissemina- 
tion efforts? Should EIRI 
sponsor an annual Efficacy and 
Cost Analysis Conference? 


Pp. 58-64 


Dissemination plan. 


How can we improve overall 
Institute plan for evaluation 
of operations and impact? 


Pp. 68-86 


Draft instruments. 


How can we Improve Institute 
Management and Time Tracking 
efforts? 


Pp. 71-86 


Draft instruments. 
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Methodological Issues Task Group 
(Membership: Glass, Ramey, Levin, White, Taylor, Austin, Watkins) 



Task/Questions 


Relevant 
Sections 
of Proposal 


Resources Which Will be 
Available at the Meeting 


Develop matching strategies, 
and select samples for cost 
study. 


Pp. 30-44 


Demographic. characteristics of 
accessible population in 
Seattle. 


Identify "effects" instrumen- 
tation for cost study in- 
eludina fpaslhiHtv nf 

w luw my 1 CQ3 IU 1 1 1 LJr 01 

administration, recruiting and 
training diagnosticians, 
whether battery 1s common for 
all handicapping conditions 
and if not, how to standardize 
scores for comoarison arrows 
types of handicap within group 


P. 41 


Specimen sets of tests listed 
in proposal, review of tests 
from Buros or similar 
compendlums, information about 
availability of diagnosticians 
in Washington, outline of 
training procedures, reviews of 
other studies using same 
ins tru men t . 


Develop matching strategies 
and select samples for 
Hearing Impaired study. 


Pp. 45-48 


Demographic characteristics 
and degree of accessibility of 
potentially available 
populations for control group 
and experiment groups 1 and 2. 


i u ci j u i i j 1 1 1 o u i u fiici i ua u i un r or 

longitudinal Hearing Impaired 
study Including feasibility of 
administration recruiting and 
training diagnosticians, 
analysis issues relevant to 
selection of measures. 


D A7 


Specimen sets of measures 
listed 1n proposal, summary of 
scoring procedures proposed for 
language, samples, reviews of 
tests from Buros or similar 
compendiums, outline of 
training and data collection 
procedures. (See note #1 above) 


Review meta-analysis coding 
system/conventions (make sure 
important concomitant 
variables have not been left 
out and conventions are 
sufficient); procedures for 
collecting inter-rater 
consistency; and procedures 
and content for training 
sessions. 


Pp. 13-29 


Draft copies of: 1) coding 
system/conventions, 2) 
procedures for inter-rater 
consistency, and 3) content and 
outline of procedures for 
training session. 


Discuss procedures for col- 
lecting cost data including 
Ingredients accuracy of 
Information, feasibility, and 
timing. 


Pp. 30-33 


Draft list of ingredients and 
suggested procedures. 



194 

er!c BEST COPY AVAILABLE 



171 

During the two day meeting the members of the advisory committee made 
30 major recommendations for consideration by E I R I staff. These 
recommendations are presented below followed hy actions taken by EIRI 
staff. 

1. In selecting the variables and specific measures to be used in the 
cost-effectiveness and longitudinal studies, it is important to 
develop a conceptual framework which describes the specific way 1n 
which we believe early intervention is functioning in these two 
settings. Craig Ramey described his approach to this task using 
General Systems Theory. He argued that a conceptual model such as 
this should be used to explain the intervention process and that 
instrumentation should then be based on that model. Such a model 
would provide a programmatic basis for future research and could 
also be used to rationally defend the outcomes we decide to measure 
and not to measure. Given limited resources and relatively small 
sample sizes, the model would also help to delimit the types of 
outcomes which were important enough to measure. It is not 
possible to measure everything, so it is critical to decide in what 
areas it is expected that intervention will have the biggest 
impact. 

Action Taken 

EIRI staff addressed this recommendation in two ways. A conceptual 
model based on systems theory was adopted. A paper detailing the 
Institute's approach to measuring outcomes was developed. 

2. Although designs such as the longitudinal study and cost- 
effectiveness study are frequently conceptualized as analysis of 
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variance designs, there are major advantages In looking at multiple 
regression and path analytical analysis strategies. Such analysis 
strategies should be considered even though the small sample sizes 
1n our first-year studies will make the application of such 
methodologies difficult (and consequently will require that we do a 
lot of front-end work on reducing the number of dependent variables 
and later perhaps using factor analytical or principal components 
analysis to further the set of outcomes). 
Action Taken 

It was not considered appropriate to use path analytic techniques 
during year one. Multiple regression techniques were utilized. 

3. It would be worthwhile to develop a table showing (a) variable area 
to be measured, (b) Instrument selected to measure that variable, 
(c) description of what the instrument measures and Its 
psychometric properties, (d) the purpose of using that instrument 
in this particular study (I.e., how it relates to the conceptual 
framework described earlier), and (e) why that particular 
Instrument was selected Instead of other instruments. 

Action Taken 

A paper, "Selecting Outcome Measures 1n Early Intervention" was 
written. This paper provides a rationale for the selection of 
measures and contains an appendix which lists instruments according 
to the table suggested. 

4. Some of the most Interesting analyses in the longitudinal and cost- 
effectiveness studies will be the withln-group analyses, e.g., why 
does the intervention work for some children but not for others, 
have mean levels been the only variable affected or have configural 
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relationships been affected, or do aptitude by treatment 
Interactions exist. 
Action Taken 

These analyses were done for the cost effectiveness and 
longitudinal studies. 

Wherever possible, use previously developed Instruments. In a 
longitudinal project of the complexity we are undertaking, original 
Instrument development 1s very difficult to do 1n addition to the 
tasks of data collection analysis and reporting. In addition, 
using existing instruments makes the research data more comparable 
with what exists in the literature. 
Action Taken 

Jhe three research Institutes are collaborating on common 
instrumentation efforts. 

In conducting the meta-analysis, it 1s critical that we retain the 
capability of analyzing data to account for methodological 
weaknesses and other study and subject characteristics. 
Action Taken 

The capability to account for methodological weaknesses and other 
study and subject characteristics was built into the meta-analysis 
coding sheet. 

It may be profitable to define effect size not only in terms of 
standardized mean differences between groups but also in terms of 
changes in variance and other distributional properties. A simple 
effect size measure of changes in variance would be the ratio of 
the variance of the control group to the variance of the 
experimental group. Where reported, it would be a simple matter to 
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also record, measures of skewness and kurtosis which could be used 
later to construct similar effect size measures (although these 
will probably be reported infrequently). 
Action Taken 

A calculation of variance effect sizes was done for each study 
coded. The coding sheet also allowed us to document. studies 
containing reports of median and adjacent scores. 
It was suggested that in the early stages of the Institute, several 
papers on the methodology of conducting high-quality literature 
reviews would be beneficial to the field. A position paper on why 
particular variables were selected for examination in the meta- 
analysis (I.e., building on the analysis of previous reviews) or a 
paper on the methodology of conducting literature reviews would be 
good. 

Action Taken 

Papers on standards for conducting high quality reviews as well as 
a paper summarizing findings from previous reviews were completed. 
A general principle to be followed in the meta-analysis should be 
to code Information at the lowest level possible. For example, 
instead of just coding a total WISC score, we should code each of 
the individual subtest scores. Using the computer, scores can 
always be aggregated; but unless the specific Information is 
recorded at this point, disaggregation will never be possible. 
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Action Taken 

The Institute chose to compute effect sizes on total scores only. 
While the coding of subtest scores would result in larger numbers 
of effect sizes, they would not be as valid as total scores. 
Regardless of the findings of the studies, the Institute will be 1n 
a politically controversial position. The topic area chosen 1s one 
about which everyone has a strong opinion; therefore, every report 
and article written will be heavily critiqued. The Institute will 
need to be sure that the quality of the work is above reproach and 
will need to establish quickly a reputation of doing h1gh-qual1ty 
scientific work.. It may be possible to short-circuit some of the 
criticism which will surely come, by having results critiqued by 
recognized scholars before it is publicly disseminated. This will 
not only provide an opportunity to clarify and make corrections but 
will also mean that people criticizing the work will also have to 
criticize other established scholars. 
Action Taken 

The Institute staff remains committed to report Its findings 1n an 
objective manner. Only those findings which are data based will be 
reported. Regardless of the findings, there will be controversy. 
Carl Dunsford just completed a review on the efficacy of early 
intervention which will be appearing shortly in Evaluation 
Quarterly . We should get a copy of it. 
Action Taken 
A copy was procured; 

In conducting the meta-analysis, we should not overlook the 
potential effects of early Intervention on siblings and families 
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generally. Although more difficult to assess, the effects of early 
intervention on factors such as decreased divorce, mental health . 
services, access to social services, and family stability are 
potentially valuable effects on the family.' 
Action Taken 

These factors will be examined 1n succeeding years. 

13. We should contact previous early childhood research institutes and 
get lists of all of the materials they produced during the last 
contract period. Some of these materials may be directly relevant 
to our efforts. 

Action Taken 

Copies of products produced by previous institutes were procured. 

14. Tal Black noted that WE STAR and TADS had provided some assistance 
to projects in cost analysis. A follow-up memo to Tal asking him 
to summarize the types of assistance provided and the projects to 
whom it was provided would demonstrate to the field that we are 
interested 1n interagency collaboration, and might identify 
projects interested in cost-analysis issues that could be used 
later. 

Action Taken 

All cost analysis materials produced by TADS and WESTAR were 
collected and reviewed. . 

15. In identifying further articles for the meta-analysis, it might be 
wise to set up a computerized literature filing system so that one 
could pull out the names of all authors who have more than three 
(or four, or five, or six, or whatever) articles in the system. By 
definition, these people would represent active researchers in the 
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area and could be contacted to ask if they have any additional 
articles or data which they have not reported or which we do not 
have. 

Action Taken 

Researchers doing the most in early intervention areas were 
contacted for additional articles and data sets. 
It was suggested that it would be particularly effective if the 
Institute could identify projects which three to 10 years ago had 
evaluated the effectiveness of early intervention with experimental 
and control groups. of children. In many cases, the location of 
those children might still be known to the agencies who had 
conducted the original evaluation. If one could identify five to 
10 such projects who still know where the children are, it would be 
an ideal opportunity for follow-up studies. The actual projects 
selected to work with would depend on the quality of the original 
design and the quality of the intervention, but identifying a 
larger number than are needed would leave some flexibility down the 
road. The difficult part will be identifying those projects. One 
way of doing it would be to send out a questionnaire to HCEEP 
project directors and former project directors sometime before the 
December meeting; then, as a part of our hospitality reception at 
the Institute meetings, we could meet with those people and see if 
they know about or have populations that would be appropriate. 
Action Taken 

Extensive efforts to- identify such populations were taken. The 
Institute will be working with several of these projects next 
year. 
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17. It was suggested that guidelines on doing project cost analysis be 
developed and distributed to all HCEEP projects. All projects now 
approved by JDRP have to provide cost-per-child estimates, yet no 
guidelines are provided on how to do this. Some felt that we could 
provide a valuable service by coming up with such a form. One 
advisory member felt that the task is too complex, and any attempt 
to use a standard form would oversimplify and leave out important 
variables. 

Action Takon 

Cost protocols were developed as part of Year #1 research. The 
staff of two HCEEP projects were trained in their use. 

18. Instead of focusing on conducting only true and quasi- 
experimental designs, the Institute should consider some types of 
descriptive research that would identify questions that need to be 
examined 1n future true and quasi -experimental designs. The lazar 
follow-up studies and the Perry Preschool Project were cited as 
examples where this approach had been valuable. 

Action Taken 

The Institute will be examining the concommitants of intervention 
effectiveness using data from a North Carolina population. In 
addition the meta analyses yielded valuable information about 
important research questions. 

19. Several other states were noted that may have good management 
information systems which track students from either preschool or 
first grade through' later school. It may be worth checking with 
Oregon, Colorado, and South Dakota to determine the nature of their 
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record-keeping systems and to consider how such systems might fit 
into longitudinal follow-up efforts. 
Action Taken 

Contacts were made with states having management information 
systems in operation for preschool populations. 
20. The issue was raised about why every early intervention program has 
winners and losers—in other words, some children who profit 
substantially and others for whom the program has no effect. 
Jackie Walker mentioned that she had 10 years of data from an early 
intervention program and that they had found more losers than 
winners but the data had never been completely analyzed. 
Action Taken 

, The characteristics of children who benefit from intervention will 
be an important question for future research. 

21. The suggestion was made that the Institute should establish a 
systematic way of keeping follow-up data on children from early 
intervention programs. EIRI could provide a pilot of this system 
using institute funding as seed money, and then the system could be 
perpetuated with other funds after this five-year contract. Merle 
Karnes suggested that in a state like Illinois, EIRI might be able 
to use some of the Illinois mandated dollars and work cooperatively 
with them to get such a system started. 

Action Taken 

The Institute is currently working in two states where this could 
be done. 

22. In terms of dissemination, a good strategy might be to go back to 
SEP and suggest to them that they are the experts in dissemination 
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and 1t would be helpful if they would demonstrate how we can better 

disseminate. 

Action Taken 

No action was taken although SEP does review the Institute's 
dissemination plan and can make recommendations. 

23. Regardless of what dissemination tactics are used, it is essential 
that the Institute identify the major audiences that should be 
reached and determine how these audiences use information, how they 
typically get information, and in what form the information will be 
most accessible to them. 

Action Taken 

Major target audiences were identified and strategies developed for 
disseminating information to them. 

24. A one-page announcement (the Institute may even be able to get it 
free of charge) 1n several journals which are typically read by 
early childhood people might be a valuable way of getting input 
from the field on research priorities. 

Action Taken 

Announcements printed free of charge appeared in most journals 
typically read by people involved in the field of • irly childhood 
research. 

25. Henry Levin cautioned that the . Institute should not be too 
successful with dissemination. He pointed out that the R&D Center 
at Stanford which he 1s directing is currently spending 

A 

approximately $4,000 per month on the postage for disseminating 
materials. 
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Action Taken 

The Institute's dissemination plan targets several different levels 
of information to be disseminated. 

Henry Levin volunteered to have someone from the Institute staff 
visit his R&D Center and review all of the activities and materials 
they are currently using for dissemination. 
Action Taken 

David Shearer and Cie Taylor visited his center. 

Improving dissemination efforts generated several additional ideas. 

(a) Deal directly wfth media on dissemination activities, 

(b) Utilize a computer assisted system for tracking inquiries. 

(c) Instead of general research conference, conduct a mini- 
conference involving a number of experts in the field. Have 
participants prepare position papers in selected areas for 
discussion. Produce a product. 

Action Taken 

Reporters from major newspapers were invited and did visit the 
project. A computer assisted inquiry file was developed. A mini- 
conference on research methodology is currently under 
consideration. 

Several suggestions were given as to how we could more effectively 
utilize field reviewers. Reviewers gave specific comments on 
improving field reviewer questionnaires. 

(a) Should be open-ended with examples. 

(b) Should be simple and short. 

(c) Develop condensed version for newsletters. 
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Action Taken 

The return rate from field reviewers was dramatically increased 
using the above suggestions. 
29. Reviewers should be given a reception at DEC/HCEEP meetings in 
December where they receive an overview of EIRI, a brief 
description of project initial research efforts, and projections 
for the future. Other uses of field reviewers were suggested 
including: 

(a) Setting up field reviewers on specific task forces to review 
certain things related to their area of expertise. 

(b) Enlisting field reviewers ai. part of a review team to monitor 
quality of publications, etc. disseminated. 

Action Taken 

These suggestions were acted upon. A reception was held. Field 
reviewers having expertise in specific areas were contacted. 
30. Suggestions were given for developing a field based research 
network for replication, etc. 

(a) Tap Into exisiting networks such as CEC, NASDSE, HCEEP Rural, 
Interact, DEC/CEC Special NET. 

(b) Identify networks in other areas, including Health Related 
Fields, Social Services, Child Welfare, etc. 

(c) Get existing networks to disseminate information to the field 
by recognizing both EIRPand networks In materials. 

Action Taken 

(a) A strategy for networking with existing networks has been 
developed and implemented. 

(b) The Institute has developed a collaborative relationship with 
the National Clinical Infant Center. 
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The Institute 1s currently working on plans to have existing 
networks disseminate findings after Year #1 findings have been 
reviewed by SEP. 
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CHAPTER VII 

RESEARCH TRAINING FOR GRADUATE/RESEARCH ASSISTANTS 

• 

An important part of the EIRI research activities was to provide 
advanced research training for research and graduate assistants from several 
disciplines. Some of this training has been offered at no cost to EIRI 
because of student's participation in existing ECC interdisciplinary 
training programs. The specific research training performed by the 
Institute has been training in procedures for specific research (meta- 
analysis, longitudinal research, cost-effectiveness analysis), research 
seminars on proposed studies, actual data collection, analysis and 
dissemination, individual tutorials with senior research faculty, and 
meeting specific research competency requirements. 
Recruitment of Graduate and Research Assistants 

The majority of research assistants came from five university areas: 
Special Education, Psychology, Communicative Disorders, Social Work, and 
Family and Human Development. Research assistants as a term employed in 
this report refers to both staff research positions and graduate students. 
Staff researchers are professional personnel usually at the junior level 
with a Bachelors or Masters Degree. Graduate students are part-time 
personnel who attend classes and receive salary for work up to 50% FTE on a 
project. Approximately 40 students from varying disciplines are employed 
yearly at the Exceptional Child Center to work on research or clinical 
projects. 

Research Assistants (RA) and Graduate Assistants (GA) were identified 
for Year #1 as follows: 
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Name 

Virginia Ream (RA) 
Susan Watkins (RA) 
Debra Cochran (GA) 
David Bush (GA) 
Kay Walker (GA) 
Gary Goodrich (GA) 
Dennis Clarkson (GA) 
Larry Wilcox (GA) 
Tish Cavalieri (GA) 
Tom Mills (GA) 



Primary Responsibility 
Dissemination 
Longitudinal Study 
Meta-AnaJysis 
Meta-Analysis 
Cost-Effectiveness 
Meta-Analysis 
Meta-Analysis 
Cost-Effectiveness 



Department 
Exceptional Child Center 
Communicative Disorders 
Special Education 
Psychology 
Special Education 
Psychology 
Special Education 
Psychology 



Cost & Meta-Analysis Instructional Technology 



Family & Human Development 
Psychology 



Dissemination 
James Pezzino(Postdoctoral) Cost-Effectiveness 
Training Procedures 

Training plans . EIRI research assistants had two training modes at their 
disposal. First, interdisciplinary training is a primary mission of the ECC as 
a UAF, and all students who worked on the EIRI enrolled for 9 credits of 
interdisciplinary course work. All graduate students met with the ECC director 
of interdisciplinary training to construct interdisciplinary training pland 
(ITPs) that outlined specific course work and internship experiences (other 
than the project to which they were assigned). Next, assistants met with EIRI 
professional staff to define tasks assigned within the research areas 
designated in this proposal. ; 

Research training . Two primary training modes were utilized during the 

year. 

ECC interdisciplinary training . As noted above, all graduate 
students employed by ECC projects formulated an interdisciplinary training 
plan. Many opportunities for other training or internships were provided 
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as a result of EIRI's association with various disciplines represented 
at the ECC. For Instance, students working on meta-analysis designed a 
1-3 credit practicum 1n learning about various Intervention models or 
in functioning as a member of an Interdisciplinary assessment team. 
Such practlcums were listed 1n the person's ITP and supervised by EIRI 
or ECC senior staff. EIRI also extended practica opportunities to 
students outside the project staff to learn specific procedures for 
data collection and analysis (e.g., through the Workshops on meta- 
analysis and cost effectiveness). 

EIRI project related training . Each aspect of the three research 
thrusts and major project activities (dissemination, evaluation and 
performance management system) provided research assistants with 
training opportunities. Formal training sessions on meta-analysis and 
cost-effectiveness were made available to all staff. Activities of 
each particular research thrust also gave students experience 1n data 
collection and analysis; reporting and disseminating findings; 
developing materials; and conducting training. Many other secondary 
skills were also developed by participation (e.g., working as a member 
of an Interdisciplinary team, constructing questionnaires, planning the 
logistics and content for advisory committee meetings, dealing with 
political problems 1n the field, Interviewing, programming and 
generating data analysis reports of) computer). 

Twenty-three people were trained in the Initial meta-analysis 
training worksho conducted November 11-13. The participants Included 
EIRI project staff and researchers form the 1ntermounta1n area. 
Graduate student response to the workshop in the form of workshop 
evaluations are summarized 1n Appendix 7-A. 
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Seventeen people were trained in the initial cost-effectiveness 
workshop conducted in October. Again, the participants included EIRI 
staff and interested researchers and practitioners. 

Graduate students assisted in conducting the meta-analysis and 
cost-effectiveness workshops at Rocky Mountain Psychological 
Association meetings and at Montana Symposium on Early Intervention 
meetings. 

As part of their research training, graduate students also 
assisted project senior staff in dissemination activities. A total of 
12 professional papers and presentations were co-authored by graduate 
students. 
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Workshop Evaluation Form 



.Karl White 



Nov. 11-13 Meta-Analysis 



Name 



Date 



Workshop Title 



I. EVALUATION OF INSTRUCTOR 



OVERALL RATING 
OF INSTRUCTOR 



KNOWLEDGE OF 
SUBJECT MATTER 



ATTITUOE TOWARO 
SUBJECT 



ABILITY TO 
EXPLAIN 



ATTITUOE TOWARO 
PARTICIPANTS 



17 Outstanding 
6 Better than average 
, Average 

Below average 

Poor 



22 



Very well Informed £2_ Enthusiastic 



1 Adequately Informed Rather Interested 

mmmm Not well Informed Routine Interest 

_ Very poorly Informed Disinterested 



Clear and to the 
point 

5 Usual ly adequate 

_ m Somewhat Inadeauate 

Totally Inadequate* 



II. EVALUATION OF WORKSHOP CONTENT AND FORMAT . 



1. 

2. 
3. 

4. 
5. 
6. 
7. 

8. 
9. 



The objectives of the workshop were clear 

The balance between lecture and participant Interaction 1n the 
workshop was good 



The scope and coverage of this workshop was appropriate . . . 

The value I derived from this workshop was well worth the 
time required of me to participate 

The workshop provided specific guidance and Ideas which I can 
apply In my job responsibilities 

Workshop content was summarized well and major points were 
easy to Identify 



21 Very helpful and 
understanding 

2 Interested 

Routine, neutral 

Distant, cold, 

aloof 



agree 
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u 


•a 

■o 
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so ■ 
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so 
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SA 


so 


0 
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SA 


SO 


0 


U 


A 


SA 



4.52 
4.39 

4.35 
4.70 
4.23 

4.55 

4.57 

4.55 

4.45 



III. The two best things about the workshop were? 
l. The clear step-by-step procedural methods 



2. The profuse use of informative examples 



IV, TWO THINGS THAT WOULD HAVE IMPROVED THE WORKSHOP ARE: 

l. More time to work through examples on effect size 



2. More .explicit statement of statistical background required 



Comments: Dr. White made a complicated procedure understandable. Only a brilliant mind 
could explain things so well. I applaud his efforts. 
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CHAPTER VIII 
MANAGEMENT 

As a result of their experience working in and managing large-scale 
research and development projects over the last several years, EIRI senior 
staff have developed a system of project management and performance 
measurement which refinas and extends previous systems and is based on the 
following assumptions: 

1. Detailed task analysis and timelines are essential to good project 
management. 

2. Some management tasks are done better by computers, others by 
people; effective and economical management depends on recognizing 
which to use when. 

3. Information for input into a management/performance measurement 
system must be reasonably economical to collect and process. 

4. All participating staff must be aware and supportive of the purpose 
and procedures of the system. 

5. The management system should facilitate identification of problem 
areas in time to re-allocate personnel and resources. 

The management system had two major components including (1) clearly 
outlined personnel responsibilities, time . schedul ing and resource allocation 
guidelines with procedures for ensuring timely and .successful completion of 
project tasks, and (2) a responsive financial accounting system. Year #1 
activities for these three major components are discussed below. 
Personnel Responsibi lities, ,Time Scheduling, and Resource Utilizations 

Time lines, personnel resource allocation tables, basic task analyses, 
and designation of primary responsibility for each of the Institute's major 
tasks and subtasks were developed and refined during the first month of 
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institute start-up activities. Project managers for each component were 
then assigned responsibility for keeping their component on time and for 
monitoring component activities. 

Project managers used a time tracking system developed by the project 
management team to monitor time allocations to each project. The form 
utilized to collect time tracking data is reproduced below as Figure 8.1. 

Figure 8,1 
Time Tracking System 
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Time tracking data was aggregated on a weekly basis by a project clerk 
and reported to SEP on a monthly basis. 

The summaries of time tracking information were utilized by project 
managers to review status of project tasks and to re-allocate resources as 
needed. Table 8.1 presents a summary of personnel allocations for the first 
year of institute activities. 



Table 8.1 



Summary of Personnel Allocation 



SUMMARY OF PERSONNEL ALLOCATION ANO STATUS 
OF TASKS FOR MONTH OF SEPTEMBER 

(100.00'J of contract elapsed) 
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As may be seen from reviewing this table, a total of 15,394 hours were 
projected for all project components. Institute staff members actually 
worked a total of 18,455 hours on project components. This was accomplished 
by having one project staff member (Pezzino) funded by Utah State university 
for 1,223 hours and by getting significant contributions of extra hours from 
Casto, White and Taylor. 

In looking at specific project components, it may be noted that with 
the exception of the meta-analysis component, extra hours were required for 
all other components. The amount of time required to complete t'e cost- 
effectiveness component was 6,440 hours with only 4,217 hours projected and 
budgeted for. 
Staff Meetings 

Weekly staff meetings were held for every research component. The 
project management team (Casto, White and Taylor) met weekly on Monday and 
other component meetings were held on other days of the week. 

At staff meetings, accomplishments of the previous week were reviewed, 
issues discussed, and assignments and projections for the following week 
were made. 

Each person at the staff meeting kept notes on his particular 
assingments using the left-hand column of a form developed by this project. 
During the subsequent week, the staff person would complete the right-hand 
column, not nay issues which needed to^be addressed during staff meeting, 
and hand in the form by 8:30 a.m. on the day of the meeting. The project 
director used the summary of these forms (completed by the secretary) to 
make up a written agenda for the staff meeting. 

Following staff meeting, the project director dictated the minutes for 
the meeting, with particular focus on decisions made and timelines for 
assignments. These minutes follow the format shown 1n Figure 8.2 and were 
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distributed to each staff person and the Institute Director. Copies of the 
minutes were also included in monthly reports to SEP. 
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Figure 8.2. Early Intervention Research Institute Staff Meeting Minutes. 
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At the end of each month, information was collected from staff members 
to provide SEP with the required projection information. 

Financial accounting . Official financial records for the project were 
managed by the Utah State University Controller's Office. However, to 
provide SEP with more timely expenditure information detailed by each task, 
the project provided detailed financial information with each monthly 
administrative report which showed the project expenditures by task and 
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individual. This financial Information was summarized for each major task 
using an existing microcomputer program. 

Major budget problems encountered during year one were higher than 
anticipated costs on the longitudinal analysis of hearing impaired project 
brought about by increased travel costs and increased travel costs for the 
cost-effectiveness component. Utah State University contributed 
considerable travel costs and one budget transfer was requested and approved 
to cover others. The project ended the year with no budget deficits. 
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project, riret, wa would like to obtoln eny reporto, Journol ortlclee, or other 
deocrlptione you hove ebeut your project or other projocte which provide e*porl- 
oontal dote concerning the offlceoy of oarly intervention progreoe. Wo oro por- 
tlculerly Intoreoted In obtaining roporte of reeeorch ueing rendooiied, true 
oaporioentol deolgne, However* we ore oleo Intoreoted in Quae I -eiperlnent ol 
doeigno, pro-poet deolgne, end other typaa of coooorot Ivo dote thet yield ecti- 
oatoa of what of feat tha progreo hod on children oe coopered to children oho die) 
not receive eorly Intervention. We hovo elreedy conducted an oxtonoivo 
cooputor*oooiotod lltoroturo eeerch and hkve obtained oeot of the reporto which 
ore publlehed In prefoeolenol Journole. Howevir, We believe there oro oeny 
other reporto containing volueblo date thet aay not have boon publlehed] in 

Journol foro. If you know of ouch report ould epproelote It If you could 

oend uo roferoncoo or octuel capiat If you hove thoo ovalloblo. Lot ua know If 
there ie eny coot eeeooieted with ebteinlng eny oeterlolo you oend. 

locondly, in conducting the oato-onolyolo, o critioel Ouaotlon lo whether 
verioue eurrlculuo epproechee ere dif ferontlelly effective. Unfortunately, even 
though epociflo eurrlculuo peckigee ere frequently referenced, the doecrlption 
of eurrlculuo pookegoe oonteinod In Journal ortlclee end eoao flnel roporte lo 
eo oketehy thet It lo difficult to ooke Judgoento concerning the eaoct nature of 
a eurrlculuo. 

Your eurrlculuo lo lloted in e publication produced recently by the teehnieel 
Aealitancc Devolopoont Syetoo (f ADI ) * Wo would like to obtoln o copy of your 
eurrlculuo package in order to hove it oveiloble for doteroining the typo of 
intervention pockego ueod when ertloloo refer to it. Could you ploeoo inforo uo 
whet the coet would bo of obtoinlng o copy of your eurrlculuo. Qlvon the nuobor 
of different eurrlculuo peckegoe we ere trying to obtoln, If there le eny poiai- 
blllty you noy be eblo to contribute en outre copy of yojr pockego, wo would 
oppreoieto it. However, we raollio thet with tha currant tight tlaee thet oey 
bo difficult. Wo do hove iooo oonay eveilebla for obtoinlng eurrlculuo peckegoe. 
If there le e Cuat, let ue know ond wjo will eee how for wo con etretch our 
budget . 

rinoliy, If you would Ilka to obteln on Cuecutlvo auooofy of the reeulte of the IN) 
oato.enolyclo when It le cooplatod in ebeut eight oonthe, ploeoo lot uo know ond ^ 
wo would bo hoppy to oend on* to yuu . Ihenk you for your oeoletonoe. « 

Gleiitloit Ceetu, *h.D. Werl R. White, Ph.D. 

ho.. • rn-Dlrootnr 



fi Incare I y , 



May 26, 1983 



Regional Intervention Program 
RIP Expansion Project 
2400 White Avenue 
Nashville, Tennessee 37204 



Dear Sirs: 

* ■ 

The Early Intervention Research Institute located at Utah State 
University has been funded by the Department of Education, Special 
Education Programs, to conduct a five-year study of the efficacy and 
cost benefit of early intervention with handicapped children. As a 
part of that resarch prog ran, we are currently in the didst of 
conducting a Meta-analysis of the previous research which has 
examined the efficacy of early intervention with handicapped or 
at-risk children. We are trying to locate as many articles as 
possible that have examined the effect of early intervention with 
handicapped or at-risk children, " 1 

Me have done what we believe to be a reasonably comprehensive search 
of the published literature, but suspect that we nay not have 
obtained many project reports and other unpublished documents 
reporting research on early intevention, we are particularly 
interested in locating studies which have used true experimental 
designs, but would also like to obtain reports of 
quasi -experimental, pre-post, or other designs which have drawn 
conclusions about the effect of early intervention program compared 
to no early intervention program, of the effect of one type of early 
intervention compared to another type of early intervention. In the 
course of ti/ing to locate articles we have contacted many people 
who we knew were involved in the provision of early intervention 
programs. Your name was suggested to us by one of our contacts us 
someone who might have or know of articles which should bo included 
in our analysis. 
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Since we have already located approximately 1S00 articles, it would 
be very time consuming for you to wade through the list of articles 
to sec if you know of any additional articles. Therefore, we are 
asking you to send us either references of actual copies of articles 
which you believe we may not be aware of that should be included. 
Again, we feel that we have done a fairly comprehensive Job of 
searching the published literature, so we are primarily Interested 
in articles which ahve not yet been published or are not llkley to 
have been published. If there is any cost in sending us copies of 
articles for which you would like to be reimbursed! please let us 
know and we would be happy to do that. In addition, if you sould 
like a copy of the executive summary of the meta-analysis, please 
indicate this in your return letter. Thank you for your assistance. 

Sincerely, 



Karl R. White, Ph.D. 
Co-Director 

Uttf/lj 
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Appendix 2-0 
Procedures for Early Intervention Meta-Analysis 
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PROCEDURES FOR EARLY INTERVENTION META-ANALYSIS 



I. OBTAINING ARTICLES FOR COOING 

A. Articles to be considered for the meta-analysis are obtained fro* the 
followlnq sources: 

1. Articles which previous reviewers of early Intervention effectiveness 
have cited as containing experimental data regarding the efficacy of 
early Intervention. 

2. Articles obtained through a computerized search of Psychological 
Abstracts , Dissertation Abstracts . ERIC , CEC Abstracts , index 
Hed lcus , and Social science Abstracts us Inq the procedures out) 1 ned 
In Appendix A" Abstracts resulting from this computerized search 
were sorted by project staff, and articles which appeared to contain 
experimental data regarding the efficacy of early Intervention were 
Identified. 

3. Suggestions resulting from a letter to all current and previous HCEEP 
project directors asking them to Identify final reports, journal 
articles, or other descriptions of experimental research which has 
Investigated the efficacy of early Intervention with handlcapoed and 
at risk children.' 

4. Articles cited In one of the articles being coded after being 
obtained from one of the other three sources. 

No extensive efforts were made to obtain reports from Head Start projects 
although reports obtained through one of the four procedures described 
above which utilized Head Start children were not excluded. Head Stirt 
project reports were generally not Included. Any report which examined 
the efficacy of early Intervention using true experimental, quail- 
experimental, pre-post, single subject, or correlational designs was 
Included as long as the report yielded some estimation of the Impact of 
early Intervention for participating children! parents, or family 
members. Impact was generally defined as whether a person who has 
experienced early Intervention Is functioning better than a person who 
has not experienced early Intervention, or whether a person who 
experienced one type of early Intervention was functioning better than a 
prison who received another type of early Intervention. Such estimates 
of Impact could be obtained using either comparisons of participants 
versus nonpartlclpants, or comparisons of before and after measures. 

D. For each article to be obtained, It should be noted whether It Is 
most probably an article to be Included In the meta-analysis 
(Indicated with an "I"), * review ( M R N ), or something else ("0" for 
other). Each request made should Include one of these 
designations. In the "other" category, be careful not to Indicate 
articles unlets they are directly relevant to the purpose of our 
meta-analysis. Many articles will be related (e.g., behavior 
management techniques for teachers), but we will be overwhelmed If 
we obtain all related articles. So use this category sparingly. 



When a request Is made, as complete a reference as possible will be 
entered on a 5" x 7" card such as that shown below. When an 
abstract Is available, it should be affixed to the back of the 
card. 



Herri 11 Library 



Interllbrary Loan Request to Author 




Type of Article 
Meta-analysis 
Review 
Other 



Sources of Article 
Computer Starch 
References 

Colleague** Suggestion 

Bibliographies 

Other 



. OBTAINED 
UNOBTAINABLE 



The card will be put in alphabetical order In the "SEARCH 
NOTEBOOK". Each effort (along with the data) made to obtain an 
article will be noted on the card for that article. Merrill 
Library resources should always be checked first, the Interllbrary 
Loan, then writing directly to the author. When an article Is 
obtained, note the date It was obtained, file the article as 
explained below, and remove the card from the "SEARCH BOOK" and 
file the card In the "MASTER CARD FILE". Cards In the MASTER CARD 
FILE should never be removed. After all avenues for obtaining the 
article have been tried unsuccessfully, file the card In- the 
MASTER CARD FILE: ARTICLES UNOBTAINABLE. 



If the article is not obtainable at Merrill Library, note the dates 
and sources checked, and go through Interllbrary Loan (ILL) to 
obtain the article If appropriate. Note the date i request wis 
.-nade and file a copy of the ILL request In the Fol low-Up folder for 
the date ordered. If the article does not arrive after 4 weeks, a 
check will be made with ILL to see what the problem is. 
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If the article cannot be obtained fro* ILL, a request will be sent 
to the author using a standard letter. At the time the form letter 
Is sent, a copy will be placed In the Follow-Up folder. If no 
article Is received within four weeks, a follow-up request should 
be made with a copy placed In the follow-up folder. Up to three 
follow-up requests should be made before giving up. Any articles 
obtained by this nethod should be acknowledged with a thank -you 
postcard. 



All articles obtained In Step A will be filed In the "NEW ARTICLES" file 
bv Lora. These articles will he screened by Ben to determine If they are 
appropriate for the meta-analysis (I.e., does the article contain 
Information which can be used to estimate the Imoact of early 
Interventions did the Intervention begin before 5 years of age; were 
children In the Intervention program handicapped, at risk, or 
disadvantaged). For each article screened, Ben will fill out a 
disposition sheet. For those articles which he determines to be 
uncodable (category A on the disposition sheet), lie will write a short 
explanation as to why It Is uncodabH, file the article In the 
"UNCODABLE, NEEDS CHECKING" file, an! file *he disposition sheet In 
lora*s master notebook." Gary will bs res> jnslble for double-check Inq all 
articles In the "UNCODABLE, NEEDS CHECKING" file to confirm that they are 
definitely uncodable. Any questions about codablllty should be 
raised *ith Karl* When Gary has confirmed that an article Is uncodable, 
he will Initial the disposition sheet on Category A and scan the 
references for any articles which are appropriate for the meta-analysis 
and consider whether the article Is appropriate for a "future mini 
meta-analysis (In which case, he will note It on an appropriate sheet). 
He will then file the article In "CODING COMPLETED: CHECK REFERENCES" 
file. After Lora has checked the references, she will return the article 
to the "MASTER ARTICLE" file. 



When It Is determined that an article Is probably codable, Ben will note 
the date of the determination on the disposition sheet and attach the 
disposition sheet to the article. He will then quickly screen the 
article to determine If It Is a description of a project for which we 
have other articles In the file or to see If other articles are cited 
which should be Coded together with this article. Related articles which 
describe the same Intervention project should all be coded at the same 
time by the same coder so that we have as much Information about that 
project as possible. If related articles need to be obtained, Ben will 
work with Lora to obtain those articles. Related articles will be 
clipped together and a slnqle disposition sheet will be filled out with 
all related article ID #*s on the same sheet. After screening has been 
completed, the article will be filed In the "TO BE CODED" file. 

Lora will be responsible for distributing articles to coders. Each coder 
will have a place on the shelf In 173-C labeled with their name. 
Articles to be coded will be placed on the shelf by Lora. Lora will be 
responsible for keenlnq from 3 to S articles In each person's "Code Box" 
at all times. Articles should always be coded In the order in which they 
are nn the shelf (i.e., from too to bottom). 
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CODING 

A. Each article should be coded following the procedures outlined in the 
tt ainlng sessions and staff meetings. Particular attention should be 
ojlven to the checklist on the first page of the coding packet to make 
sure that aj^ of these Items have been completed. It Is Important that, 
as much as possible, each article be completely coded before moving or to 
arother article. 

8. Tracking and disposition of articles will require the following 

procedures. When an article Is distributed for coding» the disposition 
sheet will be filed by article ID I In Lora's Master Notebook. This 
sheet will always remain In the notebook. When an article is finisher 
(final codlnq, or determined uncodable), Lora should be Informed so the 
disposition sheet can be updated. This notebook will be our master 
Information file so that at any tine, we will be able to determine where 
an article is and what Is happening to It. 00 NOT REMOVE DISPOSITION 
SHEETS FROM THE NOTEBOOK. In addition, Lora will keep a sheet for aacft 
coder on which she will record which articles have been given to which 
coders. These sheets will be updated by the coders as they finish f 
articles and will help me as the project director to keep track of ; 
everyone's coding activity so that I will be able to balance the load nn 
other assignments. The steps through which an article will go from the ; 
time It It put on your shelf by Lora to be coded are described below. 
After reading the article, you will determine whether It Is: 

1. Uncodable : In which case you will note on the disposition iheet what 
outcome data Is reported In the article, why you believe It to be 
* uncodable, have another staff member check your logic using the same 
procedures described below for checking effect size computation, and 
return the article to the place on the shelf marked "F?NAL CODING 
COMPLETED--CHECK REFERENCES". Before returning the article, review 
the references ic determine If the article cites other reports which 
would very likely be appropriate for codlnq In the meta-analysis. 
Those articles which are appropriate, mark with an "A". Be 
reasonably certain *>out the appropriateness of a referenced article 
for meta-analysis before marking It. Also Indicate with an **R H 
review articles of early Intervention efficacy which should be 
obtained for later analysis; and with an N 0 H , other articles which 
you think should definitely be In our files which are neither N A M or 
"R". Be careful not to mark too many "O'ft". 

2« Unc odable as 1t--addlt1ona1 Information needed : Coders may determine 
Tfiat an article would be cod ah le if additional Information could fc« 
obtained either from the author or from another article which Is 
referenced* In those cases, the article should be kept by the coder 
and action should be Initiated to obtain the additional information 
either by contacting Lora or f 1 1 Una out a request for Information 
sheet described below. The disposition sheet for that article she jld 
he completed Indlcatlnq that either (D) related articles have beer» 
requested or (E) Information from the author has been requested. As 
soon as the Information is obtained, coding of tiic articles shoulc be 
completed. 
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3. Codah1e--more Information requested ; In some cases, an article will 
be codahle but artrilt lonai effect sues, or clarification of confusing 
information in the article on critical attributes will be possible if 
additional infnrmation were obtained from the author or from other 
articles. In other words, enough coding might be completed that the 
article could be utilized in the meta-analysis but more information 
would result in additional effect sizes or more accurate or comolcte 
codlno. In those cases, the article should be placed under the 
author's name on the shelf Space labeled "INTERIM COOING 
COMPLETED--WAITING", then action initiated to ohtain the necessary 
information. The disposition sheet should also be updated to show 
that codinq which is usable for the meta-analysis has been completed 
hut more information is requested (r>tegories F or G). As sonn as 
the information is obtained, the article will be completed and placed 
on the shelf in the ••FINAL CODING COMPLETED: TO BE CHECKED" . 

4. Complete codahle as is ; If the article is. codable as is without 
additional information, the codinQ should be completed and placed on 
the shelf in the "FINAL CODING COMPLETED: TO BE CHECKEO" category. 

C. Before any articles are placed in the "FINAL COOING COMPLETED? TO BE 
CHECKED- or the "(NTER1M CODING COMPLETED" categories* another member of 
the staff should be .asked to check the coding. Particular attention 
should be qiven to <tem 1-5 (type of comparison), the number of effect 
sizes which were computed, the actual computation of the effect sizes, 
the checklist (especially items marked NA), use of decimals in 
inappropriate places, coding months instead of weeks, and use of H N M 
codes. This is the only check of the coding sheet done before it goes to 
keypunching, so it should be done carefully. Each coder is responsible 
for finding a person to make these checks and should be prepared to 
provide a three-minute synopsis 'of the experimental design and their 
rationale for classifying the type of design, the effect sizes coded, and 
where information in the article is located which they used to compute 
effect sizes. The checker will then independently calculate effect 
sizes. Any disagreements which are not immediately resolvable should be 
brought to Karl's attention. A list will be oosted with names of all of 
the staff to help balance the load on checking effect sizes. Each time 
someone is asked to check thp effect sizes of another article, they 
should list the article ID number under their name. When someone needs 
to have their article checked, they should look at this list and, where 
possible, ask those people to check the article who have been used least 
in the past. However, the primary concern is efficiency so don't wait 
for three days to find someone who has only checked a limited number of 
articles. Use available people and then try and balance the load among 
those people who are available. 

0. All articles placed in the "FINAL CODING COMPLFTEDi TO BE CHECKED" box 
will he reviewed by Ben to gather information for staff mnetinqs on 
convention clarifications and identify articles to he included in the 
reliability checking. 
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Approximately every tenth article to be coded will be used as a 
reliability check article. Karl will determine which articles are to be 
used as reliability articles and who will do the reliability coding for a 
particular article. To avoid unnecessary duplicative codinq on 
reliability check articles, the following procedures will be fol^wed. 
Whenever you are given an article to code, complete the codinq ft from 
M ES only. If more ES's should be coded, list the additional ES which 
you think should he coded on the back of the first page of the codinq 
packet. Complete all steps In the checklist except 16 (alternative ES 
computation^ 19 (request for additional In format for \ #13 (description 
of Intervention), and 114 (dictate abstract). Then check with Lora as to 
whether your name appears on the disposition sheet. If it does, finish 
codinq the article including all ES and all steps in the checklist. If 

rL™?^' 1 ' ?! lce the lrUcle 00 the MFINAl COOING COMPLETED: TO RE 
CHECKED 14 shelf. People doing the reliability coding will not know which 
articles are reliability check articles. In the early stages of codinq, 
more frequent reliability checks will be done with people who are having 
trouble achieving consistency with other coders. Ben will be gKvi a 
list of all articles which are reliability check articles. When an 
article has been placed In the "FINAL COOING COMPLETED: TO 8E CHECKED" 
category and Ben identifies It as a reliability article, he will olace 
the article In the "CHECKED--COMPLETE RELIABILITY" box. 



When all of the articles for a particular reliability check have been 
completed, Ben will compute Interrater reliability using the procedures 
outlined 1n Appendix B to compute the reliability of the article. Ben 
will summarize these data for Karl who will use them to conduct ongoing 
training with the staff end to modify conventions, tn addition, Ben will 
accumulate the data from each reliability check Into a master summary of 
Interrater reliability. Reliability results and issues will be raised In 
the weekly staff meeting and necessary modifications to the conventions 
made. After a reliability check is made, the primary coder (whose name 
Is on the disposition sheet) should check with other coders to achieve 
consensus on any Items coded differently. Changes should be made on the 
primary coder's sheets, and coding sheets for the reliability checkers 
should be fileo i "RELIABILITY CODING SHEETS". The primary codecs 
packet will be filed in the "CHECKED: OBTAIN REFERENCES" slot. 

After articles are placed u\ the "CHECKED: OBTAIN REFERENCES" slot, Lora 
will review the references in the article to obtain any references that 
are relevant to the meta-analysis project. She will also separate the 
pages on "Notes on Clarification of Conventions", "Descriptors/Guidelines 
for Annotated Bibliography", "Future Mini Meta-Analyses", and 
"Description of the Intervention Program", make sure each of these pages 
has the article ID number clearly written on It, and file each of them In 
the appropriate file In the master file. She will also check the 
DISPOSITION SHEET file to make sure that the disposition sheet has hsen 
updated. Sho will then return the article to the MASTER ARTICLE file. 
The codinq sheets will be returned to the file labeled "COOING SHEETS TO 
BE KEYPUNCHED". Whenever there are more than four effect sizes codable 
from an article, all of the codinq sheets relevant to effort sizes 1 
through 4 should be stapled together, those relevant to effect sizes ft 
through 8 should be stapled together, etc. 



260 



II. When codinq, pay particular attention to completing information regarding 
(1) description of the intervention, (2) articles relevant for future 
mini meta-analyses, (3) annotated bibliography, (4) compntat ion of 
alternative effect siies, and (5) clarification of conventions. More 
specific instructions for each of these categories are qfven below. 

1. Description of intervention. Each coder should make a photocopy of 
any information from the article or report which describes the 
details of the particular intervention program used. Attach this 
Information to the coding sheet when you complete the coding for that 
article as described above. This information will be used later as 
we analyze the contents of each Intervention and attempt to 
categorize interventions into different types. Our plan is to have 
one or two people work on this aspect of the project intensively over 
a two- to three-week period after all other codfnq is completed. 
This should enable us to more accurately categorize the types of 
frequently used interventions rather than developing an elaborate 
sorting system before we know the actual content of the domain that 
is beinq sorted. 

2. Future mini meta-analyses* Page 11 of your coding packet includes a 
numher of topics (at this time, 16) for which we want to identify any 
articles which cod Id be used in the future for doing an in-depth 
analysis of these issues. The reason for having the sheet is that 
one of the most difficult steps (n doing an analysis of issues such 
as these is identifying the articles which are relevant to a 
particular issue. As we are reading the hundreds of articles which 
will be read during the primary meta-analysis, we will note certain 
articles which are beinq read which are directly related #o that 
issue, or the articles we are reading will refer us to other articles 
which they suggest are direct!/ related to that issue. To modify our 
primary codfnq sheet so that it would provide us with the information 
necessary for a detailed analysis of those issues would make the 
primary coding sheet extremely cuntoersome* Therefore, the 
alternative is to note which articles are relevant, then when we 
finish the primary meta-analysis, to go back and for each topic 
create a more detailed analysis system which will apply only to those 
30 to 50 articles which we have identified. For example, the 
relation of Parent IQ to intervention effectiveness has been 
suggested recently as an important concomitant variable in 
determining the effectiveness of early intervention. This 
information is reported in very few articles, therefore, ft does not 
make sense to modify our codfnq sheet for the primary meta-analysis 
to collect data about thfs topic. However, as we are ieadinq a 
study, we may find information, related to this Issue; or vie may find 
references to other articles which do provide relevant Information. 
In that case, we should list the ID number of the article which we 
arc coding under that particular category or the author and year of 
the articles to which they reference us. Most of the factors listed 
on that sheet are now self-explanatory. If you have *ny question 
ahout what types of articles should he Included in each category; or, 
if during the codtnq process you want to add another topic, see 
Karl. 
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3. Annotated bfblfoqraphy* As a part of the contract, we are to be 
developing an annotated hf b 1 f oqraphy of research whfch has examined 
the efficacy of early Intervention. A sheet for provfdlnq 
information to he used In developing the annotated bibliography Is 
attached as the last page of your coding packet. Under each of the 
10 categories at the top, check all the descriptors whfch apply to 
that article. Then dfctate or write a ISO-word (maximum) abstract 
using the guidelines provided. Marilyn has dictaphones available for 
checkout for dictating the abstract. Only check out the dictaphone 
when you are ready to dictate, since we have a limited number. 
Remember that your abstract will be read by other people and 
referenced hack to the Institute, so resist the urqe to he 
inflammatory. 

4. Computation of alternative effect sizes* Many articles do not 
provide the information necessary to calculate a standardized mean 
difference effect size directly from the Means and standard 
deviations. Therefore, alternative computational procedures have 
been suqqested and are frequently used. Each of these alternative 
computational procedures makes different assumptions or Ignores 
Important information. We are Interested In determining the degree 
to which these assumptions or use of alternative Information alters 
the estimate of Impact that will be derived. The best way to make 
thfs determination is to use the alternative forms of Information 
that are available 1n the same article so that we have different 
estimates of the same parameter (i.e., Impact of a particular 
project). A form Is available that should be attached to your coding 
packet whenever alternative effect sizes can be calculated. 



For example, suppose for a particular article, you are able to 
compute an effect size using final status means and control aroup 
standard deviations. You should also compute the following 
alternative effect sizes when the necessary Information is available*. 

a. an effect size using final status scores and a pooled standard 
deviation. 

b. an ES using final status scores and the standard deviation given 
In the test manual. 

c. effect sizes using other Information In the article such as F 
statistics, t statistics, and analysis of variance tables, 
proportional data, or exact probability levels. 

Whenever you can compute an effect Size using some form of means and 
standard deviations, there are generally several other ways to 
compute such an effect size. The most preferable information to use 
is outlined in the conventions and is reproduced at the top of Flqure 
1. Flqure 1 also shows for each way In whfch an effect size can be 
computed usfng means and standard devfatfons up to three alternative ro 
effect sfze measures usfnq means and standard deviations which should a 
also he computed, In many instances, you will not have the . 
information necessary to compute all three of those suggest!*! here. Oi 
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Whon available, however, all three additional effect sixes should be 
calculated. In addition to the alternative effect sUes us inn means 
and standard deviations, you should calculate as many as possible 
effect sizes from Information such as t ratios, analysis of variance 
tables, proportions, etc. The possible sources of Information are 
listed In Item VI -2 from the codlnq sheet, categories 4 through 13, 
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Clarification of Conventions. As codlnq proceeds, It will be 
Important to clarify the major types of decisions which were made 
from the conventions, The conventions cannot possibly cover every 
Instance, therefore, for each article you should note how conventions 
have been Interpreted for the particular article you are coding for 
the major (incisions which were not fit exactly by tin? conventions. 
An example of how this sheet should look Is Included In Figure 2. 
Follow this general format In writing your clarifications, be 
cnnclie, and unless there are very unusual circumstances, do not 
Include clarifications for more than five to 10 points for oach 
article. 



I. Whenever you are codlnq and have a question about how to compute an 

effect slie, whether an effect size can be computed from the data you are 
qlven, how to Interpret a particular convention, or whether an article Is 
really appropriate for the meta-analysis, talk with Karl if he Is 
available. If he Is not available, check with at least one or two other 
people, make a note on the clarifications of conventions and proceed. 



COKMEIflS OK CODJKS COKVSiriDMS 



Ariicit \Uf 



h'otci on CUHfkttlon ind Expansion of Convent Ions -» 



3T - 



3S*br*i Hm r»«A*^ ^Ait^d tyn^ ^tui ^i*^ 

rinma oa+^I gr*^ de****^ (wi* i* 



*^ u * .W «4# 15 . 

Figure 2. Example of how Clarification of Coding Conventions sheet should 
be completed. 
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111. OBTAINING ADDITIONAL INFORMATION 



There are several Instances in which additional Information will need to be 
obtained from authors or publishers. Form letters have been developed and 
are available from Marilyn for the following purposes. 

1. Requestinq a specific article (Initial request, follow-up, and thank 
you). 

2. Requestinq additional articles, reports, or descriptions of a specific 
project (Initial request, follow-up, and thank you). 

3. Requestinq Information about means and standard deviations with reference 
to a specific article (Initial request, follow-up, and thank you). 

For each of these requests, a form jr a postcard should be filled out 
Indlcatlnq the specific Information that needs to be Inserted Into the form 
letter. Copies of these forms are available In the coding room. At the top 
of each form Is the space for the author 1 ! address or as much descriptive 
Information as you can provide concerning the author. If you do not have a 
specific address or If the address you have Is older than 1978, Lora will 
take the Information which Is available and qo to the library to one of the 
directories of university faculty, APA membership, AERA membership, or AMA 
membership and try to find an accurate address. If she Is unable to find a 
recent address but has an bid address, she will send It to the old address. 
If she doesn't have an old address and 1s unable to find the address, the 
request will simply be filed, the. requester will be Informed, and we will 
proceed without that Information. If Lora Is able to find an address, she 
will qlve the form to Marilyn who will see that the letter Is typed and a 
copy of the letter Is put In the dated follow-up file. This follow-up file 
will work the same way as the follow-up file for requestinq articles now In 
operation. After four 'weeks, an automatic follow-up request will be sent out 
to those from whom wo have received no Information. There will also be a 
thank you postcard available for each of the types of Information which Is 
obtained. Lora will also keep a file on the names and addresses of those 
people who have requested a copy of the executive summary of the 
meta-analysis flndlnqs. Whenever someone requests a copy of this summary, 
their name and address will be filed In this file and there should be a ' 
dissemination sheet completed for them which should be turned In to David 
Shearer, 



IV. FLOW CHART OF CODING ACTIVITIES 

Pictured on the next Dane Is a flow chart of the most Important activities 
which must occur during the coding process. 



V. £ I R I TEST MANUAL 

Dennis has compiled a test manual which contains descriptions of the most 
freouently »ised tests which will be encountered In the meta-analysis. As we 
continue to code, this test manual will be updated-and other tests will be 
added. For each test which is now Included, there is a short description of 
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the test, Information concernlnq reliability, and norms (In some cases, for 
various subsamples of the normlnq population where this Information was 
provided by the publisher or by other articles), and Information concernlnq 
which subscales of the test should be coded as separate effect sizes If 
Information Is available. When an article provides Information about 
subscales on a test, you should refer to the EIRI test manual before 
computinq effect sfies for all of those subscales. In many Instances, 
subscale scores should not be computed. Additional Information Is contained 
In the conventions about when to compute subscale scores and when not to. As 
you are codinq articles and come across references to articles which probably 
provide Information on the reliability or norms of a test which Is belnq used 
to measure the Impact of early Intervention, this Information should be qlven 
to Dennis so that he can decide whether to include Information about the test 
In the manual, tn addition, whenever you have questions about the nature or 
quality of the test *Mch Is being coded, those questions should be referred 
to Dennis first and, If he Is not available, to Glendon. Pay particular 
attention to the testing threats which occur when an Intervention program is 
developed using the same test items which are used at the end of the program 
to measure intervention effectiveness. For example, suppose for an IQ test 
that the sneciflc items from that test are taken and developed Into drill and 
practice routines, children are provided with drill and practice on those 
specific Items, and then the test Is given again. This would constitute a 
serious testing threat to the Internal validity of the experiment. In many 
Instances, the brief description of the test and the type of content 
contained In the test will allow you to make this decision. 

VI. META-ANALYSIS STAFF MEETINGS 

The meta-analysis staff will meet weekly (during Spring quarter, It will be 
every Tuesday from 11:00 to 12:00). Before the meeting, the following tasks 
should be completed! 

A. Ben will review and copy all of the convention expansion clarifications 
for discussion by the entire group. 

8. Ben will complete the computations for reliability checks which were 
completed during that week and provide this information to Karl. 

C. Lora will note any problems staff are having In the way they are 

requesting articles, requesting Information, or any of logistics of the 
codinq process. 

All of these Information will be given to Karl who will then raise the 
Imoortant points during the staff meeting. In addition, we will use this 
time for Inservlce Instruction In coding (discussing Issues which have arisen 
durinq the previous week which are not sufficiently covered by the codinq 
conventions and which miqht be oroblematfc) and computation of effect sizes 
when means and standard deviations are not given. Everyone should make every 
eft rt to attend this staff meeting. With the number of oeople codinq which 
we have, It is essential that we coordinate our work and this will be the 
only remilar time during which this can occur. If you are unable to attend a ^ 
meeting, it Is your responsibility to find out what happened at the meetfnQ i 
and what asslqnments were made. /A »p 

2 b 



Appendix 2-E 
Coding System Used in the Meta-Analysis 



267 



'<Mt 1/1IVU 



n-w 

16-20 
21-23 
24-26 
2 7-32 
3)-)8 

)9 



lAviAWi/ftVJ 



{OlrtvlilaJ Ulltl 





m 


"TP " 


H3 — 


— !W 












5-7 


i 






• -9 


1 






10-13 








w 


i 







9*«cH»t1t* tf C«hnHim ftr Ik* It 



I, nfviMH AtttH *•» 

I, cmtirtAi *7f tS 
~ " 3* f*lff **** 

*, tilt MMt HllH 'K CS« 
"""" i. C*H*U MM €4*4*11*1 
~(D lUlfMtlW IS ClflMtltlW 
~T «TtlClt HlWlHIW l"Ht 

c«m1«i« 

., I. iuMHil*t ** 'witrt 

i • mur««ti* A »i. l*tir»i*ti» It ® r«*>#itt Jk 

) • ki-hu **4<yit*i 4 • tr*>Mit ~ «1*il U'twitt* 
tfjult* V *r»tt I • IMftl , 
u4J«t Mitfili I • iMirvmsto w. 10. u ttfitt iHt 

»tic*ti > • •licit* **. €t*tr*l M««IH J* 

II, ttftottt?** r«lHAM |f 

~~ cm i/fttti*i*«ii *tn 

«4 |1»4* '4 04 

Jt« tf*«44 MM Cltl U tMVtl 

«t4iutt in *4*ic**t tarn 



SMy 10 1 

Cffwt Jill '») * l^sJiwrl 

S**CI ) 

Tim t# C^firliM 

(Hi 



Q MttfMi tutu* 

— tT oi 



|t'.'fo«iM!fri»niftumn] 



1 111 


F !J7~ 




15* 


1. i 


1 










! I 




! 

i 








2. 


i 










! 
i 








1. 












i - 






4. 




I ; 


1 



.CiMrtMftUl (•-.) 

.C4*Uil (— .) 

*M |Q (Ktwll 
.UMftMMlt ( — .) , 
CtAlrtl I—.) 



"TTiiTr 



. gl*tr<*«*t|t (•♦.— ) 

CoMrtl (.-. — » 
SIS (1 • I • 

^tr«l 



(M* US tfitiratfttf) 



*«tU f 0i» III »««I4 * Jl* thl iftfom«tl6A CW<«t St ll».#f*<iNi "V t**wH * HH " tht it 

~ ~ idoPcMU ^ tn« coMirUM Mint fioiH. 

(11 



26 8 



41 
42 

4J-4J 

44- 41 

49 

JO 

H-52 

»-»4 

»-S7 
J0-4O 

41-42 
43-44 

45- 47 
41-70 

71-73 

74-74 
(10) 

1«J 
4-4 

7-f 

10-12 

13 

14 





IS! 


"HI 


in 


i. f 




























i. 1 

i 










< 










• 

1 
\ 










( 










1 

1. I 

I 




















1 




















1 




























1 










1. 












1 


1 


1 


1 




















I" 














! 




! 










11. 


1 






! . 1 , 



(1 ■ rt'tfTM, 4 i CIHtwt. t • CMl««lttN« I • tlMf, 1 
m |a t r4—lil 
( Ctfttrtl 
t MALI ( — .1 
t tiftHniUl 
, CMtrtl 

*lttflITV 0P HAMtCtf (1 • IttatflMfyt It r1«l/«1«lftiMlMj«4. Mr«tr« 

4 • ItCtrMtAMUl tftm U *||| I 1 9* tM 

. tittr^MAiil 
.CMirtl 

cur nmnsan ? OTcnv u s?ns nmnmun 



A, ^rtairy *IUNlUMl«if* C«MH14A 
bMrtwtnitl 
OiAlrtl 

I. I tf fa»1t ««!• ^4««ry # H|t4tOt 4 

( — .1 

UlMflMAIil 
C«Mff1 

S#C4«i4rjf 'KlMfUttlftf* C«JMll1tN 
EtMf iMMUl 
CMtrtl 

% %t \m%\% vim SttiNify tr Otnir 

tiMrtaMllI 
CtAlrtl 

i MiRnm iii urn* 

A< « 4UUX 

Ut^lMMtlt (■•••) 

Cwtnl (^.) 
CAAO 11 

(«tff 4 At"tll '—.1 
Cttirol !•«.' 





' ■ *vlt1li«*4tutM4 
* 4«irf«i latllrM 

4 ■ 14 

5 • Sm«aA«M**M !«f«(r«4 
I 4 LltfMM 01II41M ( 
> ■ 0rtN4441Cll1| U#4lrt< | 
I ■ JtMr HttlU Wiirti | 
4 ■ tttCltatH| llllirM t 

U • H4« 111* 1 

it • d1li4tt«iH44 i 

i illicit J j 

! 14 ■ CttlMtlM I 



C« * OTHt HlKJAUf (UMvl 4Hf <(it t tr ithK t*»«ri41«* 

tittrlatfllit t — .| 
Unirtl ( — .J 

«0CAAW|C SintM (t « <iMt«f illy; 2 • <ity/ti9ur9i«i ] . 
'If ll/f^ltl 41113* « ■ Miy II IIIIMtl) 

llHflMAItl 

Utirtl 



m 



26£K» 



ERIC 



best cow mum 



15-17 
10-20 

21-2) 

27-29 
30-J2 

33- )5 

34- 31 

39-41 
42-44 



43- 47 

44- 30 



31 
52 



53 
5* 



53 
56 

57 



; — 1*1 — 


127 




T7T3LJ 


U. 1 





































































































HE 



3C 



ZEE 



A, 1 fr» *m 
ItaartMntit (— .) 
Ctnirtl |— .| 
•• 1 tflth falMr «• IM KM 

Oaatrtl |— .1 

C, Avar** «*4ar * »tt*f* m (lac1«4A4 tar*! t*tU) 

lAMTf««Mll1 (-.-I 

Cafttrtt 

|, NHHtfit AvirifA HtfMT 4# J44f« WiMMif (Mlilii 
UNTlMNllI l-.-l 

Cafttral l-.-l 

I. FitNrti *t#m af iaam KMtllH «ABAl*tn 



0 MAM Ml if C*U4 it ttw itttfanttl «* MUUIM <aaAWl) 
_ U§ » » t— til (*«.) 
Ctatrtl (—.1 

ff) KTTIAA U • *4« 44**, t • tlMtrtw Hi*. ) • r«*lAa»IUI/ 
^ fetfllil, 4 - AKtaft 4##kWcll4U. I • ItMr HaAlciltl 
I • ■tiai (taactfy a(a la *rt»t*tj44 » rc. i 

^ ll ff 

CaMral 

©Mtttt TA tMtCM MTUVOTIAJI HAS •TAllOWf MINI* TW SArtti Itttl 
CM OIMWSTIC M OOKXAlWie t!tf«A*AflOA (I • M MrttcvUr Mittariaf 
if iMir^t^, 2 • IfttArwAttAA I444M4I *UU4taA\ 3 • tittnrtft* 
lit* lufelllMUfly *U1t4f«4*| 



_ IxMTlMMll 
_ C4*tri1 



©HWOLVtMNT 0* VAAIftfl tlTWUOAS Ulft (Mill (!•• Mly 
2 • aAjAf tatanaaar, 1 • t«i4m*4f • A * *44 * 



, tat*n444f. 
1M4fV4*4r) 



!iMr«<M*Ul 
C*»tra» 

TiKHtr • *afattH*tl 

CaatfAt 

(11 



In Saction IM, *.4n it it tn aiptriiatntai control grouper pra-poat coflpariaon, * anould 
alwaya ba uaeu in calls dAAcMbing tha contrui groue. If it II An mUrwtnUoo A wartua 
intafvantion 3, a or raal luaUr *ho«jl<l 04 uiid Tor circlad Km nurtara (do not um 

, Tor item nu»MM without Cifclaa, * ltaailO bo uaad If tho woapoftant daacribad in that 
total Um »aa not An i^ntandad part of tho trtat»ont| othamiM 4 M - M or faal nu**r 
ahould ba uiadi 



39 
AO 
41 
62 
43 
64 
43 
44 

4? 

a 

49-71 

tt-74 
(SO) 

i-j 

4-4 

7-10 

11-14 

13 
14 

17 
18 

19 

20 

Zi 
12 



C, Aldl. Twttr, «r AuttUAt 
t«aaH«4*ttl 
Contra I 

Itftart W»Ua («.a.. «T, Sn«cn. toclil «4f*ar. HytaalaAHtl 

l«atr*««ntil 

CMtral 

I, MMlCll !"*0. M, 'tyCMMMIt) 

Caatral 
f* OtAAf 

Iia*f'»4ai4» 




( fiitriBant«l 



-J 



I. ftftATIOt Of CMIL0 rOCVSIO !9TttVDCnCN 

A, AVCRAIC NOMAS ar CAI1A Facutti latarvaatlM H4 W t-.-l 
flA4rt«4At4l 

_ Caairal 
tea a# | SO 3 ! 

I. 0UAAT10A af CMIA *AC«rt4A I«tar»m1a« Iff «WS ( 
_ !utr tewlil 

. Caairal 

C. T0TAI HOMS af CAUA FacMiaA tatamatlaA ( 
Caatral 

Mwcitiaait < 

i • atnar , tt«i'y 



iaaeit>A#»i1 "sur*"^-- 1> 
. tiaari*anti1 
a Caatral 

roA cducat:cml :athvmtic« 



t fnH'All , 

. Ilia*, i • Slat* 

'II* : 641/ ital/ a .a 



, t*a*r ««wui 
i. 



«?4 «a^a:?* ?f 



?t«ti 0» '.^ IKSi'Stui '1 • **v ltrj«^*4. 

j t • ?lrt-fllt K».«i*«a. 1 • *at rtrut^atf, 1 • -a 'A%t#4t*s«a 

B fiitr ( nMtlt 
b C9«ral 

(I • •««!/ «aill :oMf»MH. i • mti\t www «am»A||m) 
b »«*»•. It 

i 



ERIC 



270 



BEST COW AVAILABLE 



AC 



271 





m , 




III 


— ni 








2J 












g, focus <* uuartOMi imhhcmuon 

1 • >'M*H« 1 * HAloloril 

I • tol'-oolp A • COOAttlvo (ori osnAonk) 

3 • *M*r 7 * (OnOloiltOA 

A • lifl>l.^llill i • lllW • <*!■!£ 1 f M 

Cioortoooul 


• ? 

47-68 


24 














25 










© Otl MOMAM USf A STATIO TttOCTlCAi. AffAQAOl (0 • MA, 1 • IM. 
tOOClry) 


49.71 














72-74 














Control 


(80, 


27 










® 


TMAWCWT MlMHO TQt 1 • poroni only, 2 • cnllo only, 1 • i*rOM 
A emit tout nor. 4 • 9*0* A C«1 14 tlOOMtlly, S • MIA |*f«AI tM 

tkllA kit Ml Clttf Itt 1 If 1 












UooHnonUl 




28 












Control 


1 












II, 


fQA fAACAT TMINIM MH^tATI 


2 












A. 


AVtAAtf MUM Of rAACNT TAAlMtM fU WEI (-.0 

fioortooniil 


3 
4 


)2«)4 












CAMril 


350? 










1. 


ouaatiom of mw taaiaia* in uas I *.i 
froorimtil 




38-40 












Control 


5 


41*44 










£ # 


Tfltii MMAA Of AAAMtrf YlitltnO I »<■* 1 

tAporlaonul* 


A 


45.48 












, Control 














11. 


fCA ^•AOMl^Alf ^ IMTUVtATTOA OEMNMRTS 
















A* At*** t if HlHl %mt OMtft «lt* OOfOAtt or f«1ly U tuporvtlo/ 

miti mHii hoM«oiio4 trimioo, I 


7 
8 












( EJOirfeOnUl 




>;->4 












Control 




Ji-57 












1, i «riM k mm toonl nitA Mf mi or tolly no**** to 
tin «tt* (HM-tilM triuint (—.♦) 

hAATtMAIIl 


* 

10 


38**0 












Control 








I 








C. MltVTA ** «^4-4»IH ffN/M 0 • trilnlno, a l4f«lll« Ot 1AtOf<t«l1*0. 

HII. t • DIN Vjlftf Ui »y nootolly, ) • nuorUl/toy iwli, 
4 • WlllA/MtUl IOr«lCI. 1 • {>«l«iHM 


11 
12 










(jilOrlnortUl 




s2 




1 


1 




Control 


1) 

«■ 


a ) 






i 






0. »«rtftll *ro»IAoA jrltion AiKHlllOA Of MOOftly 'IHM AClMtlAft 

(I • jH, 0 • HI 












*iMf laoAlol 








1 i 




Control 


' 14 
i *i 



272 

BEST COPY AVAILABLE 

9 

ERJC 



II. fOA «Cf ftTIA IASID* tHTUVCRTIQOI COMPONENTS 
A. OHU/tntorvonor into (-) 

llOOf teOMUt 

Control 

I. fort on l mo if cAllAroN mo M4 orovlMily feonn In i Mono AoioA 
Ktorm (.-.) 

CiBAftaMIAl 

Control 

inA of i BB 3 i 

C, Ooorio of *tor«ot« c*<U ttorHitio* (1 • loroot cnilOfon-oonorilly 
two lyoo mo i*orliy, or om-io«om lntor«oni1oN, 2 « tiro.* 
<nil«ron«*otAor tyoo nnA MvorUy, 1 • utoortuo «un m i-^wotcnwo, 
lAoclfy rilto of lOffOi to aon^inoieopoo* i 

Cnoortaontil 

Control 

© MAAfC T8 WICM TICATMCAT Wt tHftWATt8 At HJUMfO (OK to til Win I 
(1* tontliu InolononuilOA, t • «Att of trtouoni iflflooontoA, I • only 
loon nirtt loglonontoAf 

(•oorlaomtil 

Control 

© (nfooMAriOA touAa f8A aoitt ill • u 

jl • Aoti lotoo, I - concUiiOA at tnforonto* » • caaat'I 

cone lull on) 

Cionr i»«nl|l 

Control 



(J) Midi fOMAi lArranrcotftOAt mrranv (V * no nor morsoACion, 

w f • yoi, UA ooi.i ) • m» 7*1] •ni. i 4 • yo«« IMA «oi. or noro) 
If yM. MKlfy tyy<0 of iniomontiont 



CiooMtwitil 

Control (lAlt Hon moo I A to <OAoA ovaa *on Tyto of Cononrlton t| 
not ft) 



(7) A4AACI Of INTf AM8 rnAtMf/f AMU lAHOiVlMAt IB MOAAAft 
w (I • onlAMUl* I * o«4ir4lo 4 1 • tooo 4 * • nono) 



lioortoontol 
Control 



(D fAMRT COWlTMINf/COVtUriOA TOUAAO IATIATWTIOA {\ • «ory 
w NlUIVO, t ■ HIIUlO* I • to*tv«loAt/nof«t1«0) 

Ciyorlaontol 

Control 

d|) rmm Of MOCAAM O • m*t**\ funot for iMOttoniul wiim, 
I • no or fnilontfliiM Aftlornil '^nom*, | • irooooly no utorntl 
fvnolnf) 

© C0ATtMAt8 IHUAHMY I0> rtOAAAM Afttl HC SCHOOL id • Yo. I • fot, 
v oifimtity) (AAA only to ouuVT^iliwfii coii^iio i m t cr otro 
iflir intorvintion iioM tM Ml 'ir*n ori I /otrt or aloor) 

_ (itortaonul 

Canlrol f\) 



273 



in 






THEZ 


t. 
t. 




































l. 

4. 












































































































1. 










1. 


















1 



tin 

I • rMM AltllAMM 

1 • m<+*4m m <m mumm m mImmi mt iaMm 

J • MMMtMM IT MW AAUAtM 

4 • *fi«Mtl, M tMlfil 

I • Ki'NM MjtfllM ullAJ MAH 
I ■ tlAfll MjKt/Cltl MMy 

f • critMMf 

• • «(mt HMO'y) - 



tOMtrt V SATA COUCCTW U » Mfmtuly, t • {« 
(a tim imamuM, I • tm+h mi. * • MMAiiily am) (Hm* 

, fiMf tomtit 

v Ca*irtl 

** sittt m ttami wma uMMntmrt 
unmnmn or iaau urovut to* 

(0 • Ml i KmIm, I • aimt «M«r«UMtl«i, t • MMriU 
t*4ir*tltMimi> J • Mj*» v«4Viii4miIm) 

TWUTt Tf MMOIft 

JU HlUrtllM 

J) Hliury 

m 0) IaiummiiiIm 

_I| lUHtllClt ftHMIHM 
I) uttf*Mlil MrulUy 



0 • *t • flwftllll U tM 
iiW* i#t#r««l Miuity 

1 • MtMtUt alMT atmIm to 
Mlf UuttA* UM MttftM t4t«t 
U tM imcawit ly Hlllf, 
Ml Hilly U AKMAt f»f 
MMlAAltit Mftma if MiatmA 
fit* I it 

1 i llMtllll lltAfMtlM Ml 1 4**- 

|<M rtKN ly Hlllf CMll «CMM 
ft* tUAIIAAttit AMMt if IM 

MMrvM rtiulii 
S • ly titilf c*H i*fi:m mii « 

III tf tM MMffM Mlttlll 

n) IaimmmIiu Stitttitctt rncMwit 
.OitHtftHtM if SAMli/lMinMilMfMilitll 
J) frwr (tiMify) 



(fan*. imti or vAttim 

(1 ' MftA 4— ♦ I • !*■! CM* frM CAMMItM) 

mmt m mairm iw«mtion ftovtoto Atoun 

(1 • cmaIiu lAftfMtiM. 1 • limn uitcny* 1 • Imammm 

UtfirMllM) 

A. SuljKI Vir litlll 



Ci MUM Mi Mllyttt 



274 



IS I . 



lUUIUM'J&lO • UM ' 



3A 

)> 

>A 



37-)« 



AO 



*l 
A2 

a) 







tu 













































































1. MOM masumo mi 

I i TvMt OHU 

I • Sit MM if T*r|H OIK 

} • {iM.illMni Pur T*|it CAUi 

4 • r*r«Mi 



1. •TtST* AMtNtSTtMl fit (1 • iMIVlUil, I • 
1. SOCMtM WASUMi (• « M, 1 • VM) 
4. TWI KASUNI 



SMllI r«KllMlM/MMtltl im«f. 
tMVMTMUll l*ltf«tf« 

IT»A 

iVtKMaitc//kiMi1c 

»tf«Mlt|1Cll/bMl«llll fwCtlMlM 

nu-tmm 
»ifMtiM sin it 

Hulift Slitvrt/Mnlcil VMI 
l<M4l Prt%r%% %fw\ KMtrtt 
04 Mf (t«tiifyj 



1 • 10 **TM1 II * 

I t 10 »*finiMi/NM*fir«i1 14 • 

S • IQ Ml Sciti/HMfit 10 IS • 

4 « Wf MfMMit Ml Inn U • 

I « Mm Hit if • 

I • trill Atllf II • 
P i mtW ClM I AM it • 
I • >VCMM4l 0f|MllMlM « • 
I # tlirilllVI L4MUMI It • 

10 • ftMllltM LMfttlM tt • 

II • AflKvllltM U • 
U • ClMtAM t OtMf 1»I MM 

Ml Ml 

t. ICMAAitZATtM OF KtU ACMU KASONS OA SfTTIMS (t • mi i mmati 
ftf mil MKAMl 1*1 CAMKfl, MCCtM IIIIIIM fAMMHtlllM Mil} 
1 ■ I MMVA. MtAM mtltM MMTllUlllM MMMll} I • I MM ATA, 
14 «mUAM ill AM HUM IIMriHllIlM AT MIMlM It MM l|| 

I. tllSTtiMtAt 

t • OtmlM ty lAfMI AT tfllfllAM Mf IM AT IfrHllK IMlMllMll 

}*0»!a1m ly iMaUIm, tii<Mr< ir IrilAM ir«flliliMl (mIamIvm) 
• UlMVlMi MtlAf. If IMIllAMlIri 
I i tfMltMtfltlM MjMltM miimi 
I * SyllMMlt NivritiM 
4 • SlAMtrittM MJMIIM MHWfl 
J • HylHll MIlMTAMAt 
I • ClMlAIIIM • 

t • Other, MMlfy 



MtNAAtf OATA COUCCTOfl/ttVOUtMT (!.«.. Mf IM maim akUImi Umi 
4MfM if inMt miry at iivil if fyMUMiAf* Mm t0 Mil • lilt 
AMtnlitf itif | lAiwiM aim MfMt * t*r«nt) 

1 ■ iMtr llAM IKMfAfllllMll AT lAfMt 
t • ffllAM Jlf llflfllllMll * Mr Ml 

1 • MflllllAll Ml Ml Hilly tl M if HAM Ay «trtwl l# AflfllltMll 
HUM 

4 • IrifiiitMil UMlflllHy tfilAM if Hilly U m trilAM ty flftyi %t 

IfAflllllAll mini 



tHTHMlAT ICUAItUn <1 * .« - 1.0, 
I ■ .11 • .40, 1 ' It iM tilM) 
tMHfy Milt 'iHMltlly 



•AM f | t$T|HAf ID II * MMflM 1A UMy 'M lAMflMMIll MMllllM, 

I * till MfWll/HtAf IIWI. 

I * llimilM «HN CM«MtlMl) 



It) 



ro 
i 

m 



275 







— nr— 








44 










10. 












u. 


41-50 


i H 










M-S) 










12. 















UNfftM. (JUMITV Of QUTCCHC «AtUM (C94I (Mi««At!MS) 



p fuoMaontil <•••) 
Control 





"~ TTT 






-Til" 1 


1 








42-4) 






* 












> 


44 










65-47 




1 






1 

- I 








69 ' i 


i 

! 


! 

! " i 
| i 

'. i 






' ' • i 


30 


j 




4 


4 



t, SttMOfOUM J!"tftA<0 Iffet tltf !$••■••) 

t, Qui *ten «im 3*fftf*»«i !S *4t CilcuUtH 

1 * *4Mt *0 C«MM' o/iuo SO (cott SCilt 1f in itH «)) 

I • VMM IM mlM SO 'O0l K4l« 0' *04M *B 'tl* O) 

) t «** ausifsnM tut 13 'com ua'o of mmi O) 
4 • t rotto/J ntto *rto> *o**4* ANCVA or o«4Ct orotooOity 

9 • T rail 'r«i 14U»«0 »lr» # I tit'., if * 'it<fl *rm »ti«4 «Mll AHQVA 
• • Tor * uolo 'tn AMOVX* 

J • $ »r v Ut»t fn« «-«*y WCVA or urn* wil axova 
I • .VtCOKA « rtltt 

I • <WM«««tr<< Utt ttltlttU IK411 cn1 ttulrotf 

10 • »roMftlMty MtlfAtt 'if i toot or 0M*«ly Ai*)YA 
U • 'WHO* "*4t 

12 * hw.\a*% ''oroftlt* tfOfttforMttOA) 
I) * CM 1**0 tMtl 

t» ■ OlMT 

(liottry) 

3, kilo 4' *m OiffOfuwo % IS Of #2 c<*« t. 2. of J, too fro» 

U MlH) 



t * ton oiln leant 

2 • 'itlov4l )4«n teartt 

) * cavifAAci Ac.sttn team 

4 • '<nlt ItAtut *4ttJf* 

I • otnir !ta«*'y: . . . 
4 • »f «2 *4t coon w 



4, Vift«A«| 1**04* Kit 'S( * l<? '•.♦•) 



$, AytftOr'l Concljt<0M 0 * 100 tOMltVO*. i • (AtlfVtM'ff 40#«4/t to 
w0f4, 2 * J4U Mj'jOCII M«ut fMtfvtflltM if 'tf HvtfHt, 

3 * ifltifvtflHw laoiift i«it to «cri? 

4. Ciwrttry if ttjflv -ot MA, toothy) 

1 • '1U 

2 • 5r*|Htn*t0iAi'-l nMJA _____ 

t • taf4<""ji MrM* r A*\n\ it Uvin tetr'u . 

i • tlM^ 1 

K »^f«st1on it '•»0l' , 1*0f/54t<?*tf '! • lluC4t1««i l 2 • l44CUi ^v(4t10d, 

U^WAl * ;, lMoy, * • ie4»1.1 * 4 ff4i7» 3 • 'igtrM 1 *', I • ton' iof* t 
51 ♦ JtHf 1 



276 



ERIC 



BEST COPT mum 



COHPUl Al ION Of ALlCflNAUVC CffCCI SUC5 



Article ID # 



»•*» 

(••II) 
(it-M) 

iti-ai 

|M-tSJ 

HO-SII 

(10-41) 
(«•«! 



ACCUMO Of iSftNAMM (t 
Sluly 101 

Ifftci Silt I fr* Orlftitil CHi«t 

I. IffKl tilt (».») utM it MU*M|lytU 

l. Uwf tf is 

J. AlttrMllvi CI II nil* *mi mi 1.0. 

A. Cfftcl Sill !•.« 

I. Uvrci if IS 



AUtfMltyf IS II Mill* Mm Ml S.O. 
A. Ifftci Silt 
I. $wr«t tf IS 

AtltfMM • IS I) tfttM, MM* Ml S.O. 
A. Ifftci Silt 
I, fcvrci tf IS 



I, Iff*! Sin cilciHitf trm t-ntU r P 
MtU f(M Mt.ttiy *WA r MMI 
KMAIItl/ (*•.••) 

t. tffHi Slit oUuUimI frM l>rilti fr« 

MlCMl NiM l*Ulli * ' nil* f'H 
NHUM MllWll r tlMr lit* Mill 
•r ttltt Hal AttVAIaUM ('■.--) 

I. Iff HI Sill ciUtfUttf It* S if « IM)U 

f . tffKl SUl ClkyUlN frM S If » tMll 
frM ANCOVA, riMHN atltwH, IT |IMT 

CMtll* AHOVA hum ('•:■■) 

10. IfflU SHI ClUMlltM frMANCOVA f Mitt 
U* tfftCl Slit CIHmIIIM itm flMtKMCUW 

i tit lltUtltc tutu cM-ltttft (I-.-l 

It. CffKI Slit uUtftil* frM tfMMlltiy 
til lam fir I -lit! tr Mfnty AHOVA 

<••••*) 

Cffici lift citcwtitM fr«rt|rtniM 



lifitl |< 

Ifftci Slit CikulitM fr«t trmrlttA 
(*ir«*U* Uniform It* 1 1 



Secret tf Ifftci Stif 
far .Ultra*! Wit UUft| 1 Ml SI 

|| t MMI Ml CMiral Ml*! W. 

rM ftlft ICtrt 

II • MMI Ml CMUtl ITIMt Si, 

CM* IMCI tfjuUtl utrn 
|) • MMI Mi cMlrtl ljri«#i St, 
rttllMil flit warn 

U • MMI Ml CMlftl MtwH SI, 

ritii uiiMt 

|| ■ MMI M4 MtlN SO, 
rM flln UKI 

|| « MMI Ml Mlltl SO, 

ctviftftK! HJMtlll utrti 

II • MMI Ml MtlH SO, 
ftUltfll |ilt ictrt 
II t MMI Ml MtlN SO, flMl lUIUl 
U • MMI Ml Ml l*MI lilt SO, 

tm (lift tctftt 

« • MMI Ml MHIM4 Ittl SO, 

CMATtMCt HJMtlM U"lt 
U • MMI Ml MMIMI till SO, 

rtUluil (Ha icirtt 
M • MMI Ml MlltMl Ittl SO, fltll 

ItMHt 

H • t-nilc ir f rtHO frMi tM>iMy 

AMVA tr tutl OriMOIIIIy 
tt • t-rtlli fria MUM! Nlrt 

l«Ulti ir P run frM) riMim 

Milirti ir HAtr Alitl mm I if 

I |Ut tltl AMOVA HUM 
44 • S tf I Ullt If A10VA 
41 • S If V UIU frM ANCOVA, rlNCtH 

Mitwrtt, If tintr cM»lla wlA 

HUM 
41 * AMOVA f rillt 
SO • MMiriMtrlc uit tutlltlc 

ticilt chlitMirt 
SS • prMiatllty tilfMit fir l-tttt 

tr Mt*wiy MtOvA 
AO • rtrtttlM KM! 
II • prMtrtlM VMjIt" UMtftrMtlM 
n • vttMil IMIUIIM af kim^i 1 uu 
H • ttMr 



HflCI Slit cUculllH frM «Hwtl UIHCIlM 
tf irtpAlctl Hit 



IS. 

II. Otittr, inclf*; 



ro 
m 



ERIC 



277 



BEST COPY AVAILABLE 



278 



OCStNlPTWS/GlllltCUMS m 
*W*0tAU0 HIALIOGHAPHY 



COMPUTATION OF EFFECT SIZES. 



Article ID I 



I) Adthnr/Yojr/in* 



?) HiflUicjppiiK) Condition 

_ I. Hut tl 'handicapped 
2. Hearing Impaired 
"* 3. Visually Impaired 

5. Speech/ language Impaired 

6. leaning disabled 

_ 7. Orthopedlcally Impaired 
S. mher health Impaired 
9. fictionally disturbed 
10. General developmental dtUy 
^U. fHqh risk (ncHceMy, 
gt-netlcal ly) 

12. OUedvantdjed (economically, 

culturally, socially) 

J) Severity 

I. At risk • nonoflentout 

2. Borderline mild • homogeneous 

M 3. Moderate • homogeneous 

4. Severe/profound/ homogeneous 

H S. Heterogenonut 



4) Type of Article 

m 1. Review 

^ 2. Research 
3. Assessment 
_ 4. Philosophy 

ft) Qui I very System 

1. Hone 

. . i Center 
3. Combined 



8) Mode of Intervention 

1. Educational 

~ 2. Medical 

1. Sotting chenqe 

4. Stimulation 
5. Diet 

6. Other 



I) Long-Term Impact 
Discussed 



Standardized Mean Difference 
Effect Sizes 



ESI 



t) Age Intervention Began |. Yes 
2. Ho 

1. 0*2S — 
— 2. 2»i-S 
~ J. Combined 



7) Parents used as Kajer 
. Intervenor 

1. Yet 

2. No 



10) Cost-Effectiveness 
Otscuisod 

1. Yes 

2. do 
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• type of intervention 

• simple description 

• type of design 

• dependent measures 

• results (1n K if possible; 
If not, whatever Is best) 
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WIA-ANALYSIS Of EARLY INIEAVENMON 



CONVENTIONS 



Contained In this document ire the conventions or* bisk rules for 
ro<lin>) the f «ir ly Intervention research articles. Additional examples of how 
Un»v» basic rules have been applied are contained In the conventions notebook, 
While tad Inn articles, these rules should be used to make most decisions. If 
tnforw.it Ion Is unavailable, the Hem should be coded If *n Hen does not 
aoplv tn the particular comoarlson belnq considered, code It "N". 

nrcaOooally, educated ouesses are possible. For example, a study may 
r#»nnrt thai 100 mentally retarded children were randomly aslnned to one of 
two orcmps aod nive descriptive Information fnr the experimental group (e.g., 
ikmii 10, percent male, SF.S level), but not for the control group. In this 
cue Once the samples are relatively large and randomly assigned. It would 
l.n atcwtahle tn assume (or "quess") that the control wow has the same 
ii<<mnnraphlc characteristics even though they are not reported. When guesses 
or interpretations not covered specifically by the basic conventions are made, 
Include a brief explanation on the "comments on conventions* page so the 
et.vnole can b<! Incorporated Into the conventions notebook. Guesses should be 
the exception ra ther than the rule and should only be made when you are 
7™rr«f™riffimfl~"tlie accuracy: For a few items, as noted specifically on the 
roijlnq sliceT," vou can be more liberal about quesslng, In general, however. If 
in doubt about whether or not to estimate— don't . 



GENERAL COOING CONVENTIONS 



I. Code with a 12 pencil. 

?. fry tn code ear.h document In one sitting. 

j ik* -N- whenever the variable Is "not applicable". Use for 
-Impossible to determine" or "missing data". Use "to™"* " • 
numher. Every cell In a utilised column of the coding sheet must have 
data, the "not applicable" code or the "missing data" code, 

a. ne sure to fill In all dlqlts. Include the decimal point whenever there Is 
a number tn the right of It. Including leading terns Is not necessary 
<ince ke.vounchers will rlqht Justify all Information. 

V.irvlnq tynes of duration or Intensity measures may be reported In the 
article, e.g., hours/day; days/week; months/year. In convert Inn from 
report el d*ta to information needed on the coding sheet, use 1 month • g.J 
weeks, fioto that If cnnvertlnq to or from units/year, the number or 
months the prnqram oporatos should be used. For example, If the coding 
rills for hours P"r week and the study reports 120 hours a year and a 
In. month pronram, then hours per week ■ ([120 • 10] • 4.3) ■ 2. A. 

(u Duration coding-- if the posttest tnok place during treatment, duration 
UmiilU b« measured from pretext or heqlnnlnq of treatment to post test, ir 
piKilrSt administered after treatment, duration should be measured up to 
niMimnnt termination. If article reports onlv Information In quotes 
»»»lnw, m.ike the fnllnwlnq assumptions: . 

"full year" • "school year" • 9 months 
"half dav" • 3 hours 
-full day" • 6 hours 

-biweekly" or "bimonthly" ■ twice a week or month 
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7. If the variable Is an "average", compute the weighted average whenever 
possible. For Instance, If the variable Is the average number of home 
visits i and the document indicates all parents received 3 and 201 received 
4 or 5, the weighted average would be computed as follows: 

( M \ 

Weighted average - *°< 3 > LgOi . 3.3 



6. If a variable calls for the average value (such as mean age of subjects) 
and the range 1s reported, record' the midpoint of the range. If the 
report says the range was from X) to X4 but most were between Xj 
and X3, record your best guestlmate of mean age (If range Is 3 to 7, but 
most are 3 to 5, a reasonable guestlmate would be about 417). Note that 
the midpoint of 3 to S Is midpoint of 3.0 to S.9 9 which Is 4,S and not 

9. AH documents reporting analysis of the same data base should be coded as 
a single "study*. A "study" Includes, for example, all Interim repnrts, 
reports on different topics or reports using different analytic peri pec 
tlves (Including secondary analysis). As long as a document reports data 
on the same group(s) of children, It Is part of the same study. If you 
are coding a document which seems to be related to another document but 1s 
not so Identified, see Karl. 

10. A separate column or "Effect Site* Is computed for three different 

categories of Information. First, whenever relevant outcome Information 
Is provided for different outcome variables as described on Hem V-4, (or 
example, If the article provides Information on IQ, receptive language* 
and parental attitude, three different Cffect Sites should be computed 
utilising columns 1, 2, and 3. In this case, all ether Information 
associated with those Cffect Sites would be Identical except Information 
In Section V and Section VI. If the article provides outcome Information 
about the same type of measure (e.g., IQ) using two different Instruments 
(e.g., Stanford-llnet ^nd WISC), you should compute two different Effect 
Sites using two columns and note on p. 8 of the coding iheet the different 
tests being used. Secondly, separate Effect Sites should also be computed 
for different suhsamplei or the sample which 1s described, for example, 
If the article provides Information about experimental and control groups 1 
IQs for boys and girls separately, you should compute a standardised mean 
effect site for boys and a standardised mean effect site for olrls. In 
this case, there K no need to compute a total group standardised mean 
effect site since that information will simply be the weighted average of 
the preceding two Effect Sites. A third dimension which will create 
additional Effect Sites [% If the outcome Is measured over time, for 
example, If a nine-month treatment occurs after which the outcome Is 
measured and then another test Is given one year later and another test 
one year after that, you should compute three Effect Sites. Do not 
generally compute more than one Effect Site per measure per year even 
though more tests may be administered, for example, consider an 18-month 
center-based program In which laylcy Developmental Scales are administered 
every 3 months. In this case, you should compute one effect site at the 
end of 12 months and another effect site at the end of the program (I.e., 
1 effect site for each, year or portion of the year for which you have 
tests administered). Generally. 1t will be unusual to Compute more than 
20 Effect Sites per article. If you are coding an article where you think 
more Effect Sites than this should be generated, see KarU 



mm 
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I. Shirty ID* - should he recorded on the upper rlqht-hand corner of the 
article-. If It \% not, talk with tore. 

?. Effect Site (CS) I - Record the sequential I of the effect site for which 
Information will he recorded In that column, tvery column for a 
particular study should have a unique ESI. 

3, Year - year of puhllcatlon. If not qlven, estimate by adding 1 year to 
uw? latest citation In the references. Code only the last two digits. 

4, Wrce • the specif 'c source or Journal name where the article was 
published or. obtained; coded fro* list of sources on the following paqt. 

5, Typo of Comparison - Record the type of comparison for the particular ES 
About which. Information Is being recorded In that column, If two types of 
comnarlson are possible for the same qroup of subjects, e.g., pre/post and 
ewrlment a 1 /control qroup, record only the methodologically most sound — 
unless the weaker comparison Includes additional Information (e.g., t of 
Sdmplf? which Is male) In which case, record both using separate columns, 

Children should be considered to* be In a control group If they are In the 
mist naturally occurring setting with no special activities. Instruction, 
or treatment. Anytime a child Is placed In an "unnatural" setting, It 
should he regarded as a type of Intervention regardless of the presence or 
jbionce of particular therapies or Instructional procedures, unless the 
"unnatural" setting can be considered a "placebo* for an experimental 
treatment. For example, a child placed In an Institution 1s In an 
intervention even If no special therapy Is given because It Is an 
"unnatural" setting, A child who stays at home with no explicit 
instructional, therapeutic, or training procedure given to parent or child 
is In a control setting for purposes of coding regardless of the 
tnrmtnnloiiy used by the author. However, consider 30 children who are In 
an Institution, fifteen are assigned to each of two groups with group II 
receiving m experimental treatment and qroup 92 remaining In the 
institution with normal day-to-day management. This Should be coded 
nnci (mental-control (II). 

the r.niie "4 » pre-oost, adjusted for norms" should be used whenever a 
me. post effect stie must be computed but you have a test available for 
which *ie- appropriate norms were used for both the pretest and the 
po'i t so that maturation effects are controlled for. for example, a 
rlu i,i >o Is at the 45th percentile on the flaylev at 12 months according 
to 12-month-old norms and at the BSth percentile at 24 months accordlnq to 
M-mnnMt-nlri norms would have increased 10 percentile points. 
A'ie- appropriate norms can he reported in percentiles, Standard scores 
(tniludloq WlSC-N and Stanford-Alnet IQ), or ratio If) scores. 
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II, OCSCHlPflON Of FINAL SAMPLES^ 



tnr any article with relatively large groups (nj>30) or for demographic 
tharartprlsttcft which apply to more thin 2SX of the group, If the article 
nVvribes Ihe experimental simple on a demographic characteristic and says that 
suhlwlt were randomly is si fined to experimental and control or mips, assume that 
thr control group sample exhibits the same demographic characteristics. If the 
article describes demographic characteristics for the experimental group and 
*ays that groups were matched on those characteristics, code both experimental 
ami control qrouos the same unless more specific Information Is given. For 
*K.W)lt, If tho article provides Information on SES for the experimental group 
and say* that a control group was used which was socially and culturally 
comparable, then SES should he coded the same for the contrnl group. 

If 1-5 (Type of Comparison) Is coded "l" (experimental vs, contrnl), or »2 - 
(Intervention A vs, Intervention 1), or "tV or N J\ all boxes for the control 
nrniip on coded comparisons In this section should have a number or H 
thnuld qonrrally be used for the control group Infnrmatlon If 1-5 was coded 
-3*, "4% or 

I. Mean Aon .it time outcome was measured. 
• Report In months 

- If rounding Is necessary, .5 or greater round up, below ,5 round down. 

When grad* in school Is given, but no specific age. assume average child at 
hcjqlnnlnn of klndcrqarten Is 66 months (5.5 years) and it end of 
kindnroarten Is 75 months. Use these ages for anchor to estimate other 
avoranc ages based on grade placement tton ages are not given. 

?. Moan 10 

- Mrpnrt actual 10 score If given. If range only Is reported, use 
midpoint as best estimate. If article r^pgrts how many In each sample 
arc In the various M* severity levels, use the followlno numbers to 
estimate the mean IQ for the sample: Normal • 100, Dull Bright or 
Rorderllne • ?fl, EMU • 63, IMA • 48, Severe - 33, Profound ■ IB. If 
article reports only that sample Is Down Syndrome, do not estimate. If 
article reports only that children are MR, do not estimate, f article 
reports that children are only hearing Impaired/visually 1^f'i;*Jj «J 
some other handicapping condition not generally associated with MR, do 
not estimate. If article provides "10 like" Information (PPVT, Oraw-A- 
M.m, etc.) prior to Intervention hut no true >Q score, use the "IQ-Uke 
information for this Item. 

3. SUe of Sample - Number of subjects at time data was analyied. 



«rnr all Itrms In Section II, assume subject mortality Is proportional 
,inln« otherwise slated. In other words, compute the percentages In ««h 
group ot the beginning and don't change the percentage as a result of subject 
Llallly unlr« the article specifically states how many were lost from each 
group. An exception to this rule Is rfien any demographic charac ter stlc 
account* for less than 33X of the sample before ^trltlon and attr t on Is 
«o»p lh,w 20t. In those cases, code the Item for example, If in a 
T»U of 40 children, there are IU of the children which are MIspanH : and 
at tt it Inn Is 33< but the article does not state from which ethnic groups 
chi tdrrn wn e lost, this Item should be coded - . 
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Socioeconomic Status (SCSI - Specify how SIS was determined on coding 
sheet, Examples: Low SCS would be Title I recipients, Need Start 
participants, Inner dty children, or low Income subjects. Middle SCS 
would be blue collar, or lower management families, high SES would be 
children of university professors, doctors, or upper management. Code as 
4 • mixed If the group Contains o mixture of SCS (I.e., a heterogeneous 
group) with at least lot of the sample In two different groups, If article 
states that subjects were low, middle, or high without determining how It 
was determined, use author's statement. Use the following as a guide In 
determining SCS level. 



* - '»MM*itk.r 



to **4> H h Wi<n m Mi m*, mn writM m* w 

mi~+t Mm » M U i t >* Ww tot l *+t 

HA t# . %kk to <M^4 ht$ tovfc. 



if 

1. 1 




A m* Mm W MM p») mm to mM m If »ft* * 



WT • 0 ■ MMMM MittJ ♦ * 1 WmmM 
1M% • m*rm* tf) *ft mm* mn «l mUd * ft** • m*4 m 
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Hloh — un 

Middle S M 

low— Lr=z*!L 



From: Hopkins 1 Stanley, educational a nd psychological 
mea surement and eva luation (Sth oo.j. tnglewo< 
CrrffsTf^TI PrenfTceTlall, 1981. 
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S. Source of Participants 

1 » parent Initiated - parents of target child sought out Intervention 

without any form*) or spe If 1c advertisement or recruitment on the part 
of the program. For example, the parent nay contact a doctor's office 
or other nodical agency or a school for handicapped children to request 
help for a child whom they suspect Is developmental 1y delayed. 

2 • solicited/volunteer - subjects for a particular Intervention are 

obtained In response to a specific recruitment campaign for that 
particular project. Such recruitment may be either written, word of 
mouth, or other meoSi. 

3 • rrttrrtd - subjects are obtained either through current participants In 

the program referring the aaency to other people with similar 
situations or referring their associates to the agency, or by other 
agency people (e.g., doctors) referring relevant subjects back to the 
program being considered. 

* • captive - subjects are currently enrolled In a program which Is then 
used to try a particular type of Intervention, or subjects are 
residents of an Institution which decides to Implement an experimental 
program. This code should J>e used whenever subjects or their fanlUes 
have very little or no control over whether or not they will 
participate In the Intervention program. 

S - combination - whenever fewer than 90* of the total sample 1s In one of 
the above categories. For example, If 15* of the simple was parent 
Initiated and 85X of the simple was referred, It should be coded 
combination. 

1 1 t > 

IMs Hem refers to the source of participants for a particular 
Intervention treatment. Some children at the CCC are referred from 
doctors, some result from parent Initiation, some are solicited from the 
community. The question being coded In this Item Is not how they came to 
the fCC but how they ended up In a particular Intervention program. If the 
education unit decided to try a new biofeedback program and took all 
children who were In a center-based preschool program, this should be coded 
"4 ■ captive 1 *. If they send i letter home to pirents asking which of them 
would like to have their children participate In the program, this should 
ho coded H ? * solicited". If they ask Seh to recomnend children he thought 
would benefit particularly from such i program, then It should be coded 
"J e referred". 

Ho carrful about concluding that the particular program being coded Is like 
oilier ptoqrams with whom you have had contact In terms of source of 
pailiclpants. for e«ampte { It Is not Justified to conclude thit since most 
(tiildrpn in the Exception!! Child Center's preschool program are referred, 
ih,\\ children in other preschool programs operated by university centers 
mv also referred, unless the article specifically states that. 

ft. t M.il? - Percentage of male subjects at the time of the posttest. 



7. Severity of Handicap 

1 ■ homogeneous it rhk, dlsidvantiged, borderline, or mild 

2 ■ homogeneous moderate 

3 ■ homogeneous severe/profound 

4 - heterogeneous with at least 2 of the above 

r«^?M!!!! f0 I * lir " , " , ri " v "J l * *• Provided below by handlcappln; 
cond tlons. Be sure to be familiar with the definitions of the 

ult nf^Y^u 1 01,1 f \ ,u ? 'J' 8 ' U ! e N " (heterogeneous) when 90* or 

is a different level of severity. 

m %{ 5 ht wurct of Informal Itn used to determine severity level (e.g.. 10, 
OQ, adaptive behavior measure, or dt , or Indicate if estimate was ba ed <m 

?SS* A dt I^f t<0,, • V 01 *l tm l lhit ■»•" J *" dr "" children hou dbT 
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ft. Description of Sample According to Handicaps 

A, Pi Imar.y tl«imHcapplnq Condition 

H. % of Sample with Primary Handicapping Condition 

C. Secondary Handicapping Condition 

0. t of Sample with Secondary or Other Handicapping Condition 

Using the categories defined below, record the percentage of the sample 
which exhibits the primary handicapping condition targeted by the 
Intervention, for example, If the Intervention li designed to test the 
efficacy of a particular type of home-based physical therapy for cerebral 
palsy children, then orthopedlcally Impaired should be coded at the primary 
handicapping condition even though BOX of the children are alio MR. In 
ints case, MR should be noted as the secondary handicapping condition. 
Note: On coding N 0 N , you should Include the percentage of children having 
the secondary handicapping condition noted In B-C In addition to any other 
h.tndlcapplna conditions. For example, In a sample of 20 children, all of 
whom are CP, 10 of whom are mentally retarded, I visually Impaired, and 3 
hearing Impaired, fl-0 should be coded 701 (10 ♦ 1 ♦ 3) ft 20 ■ .70, and B»C 
should he coded "4 ■ MR" to Indicate that MR Is the molt predominant 
secondary handicapping condition. Do not Include under the coding for 
secondary handicapping condition conditions which are almost always 
associated with a particular hindlcap. For example, virtually all 
profoundly hearing Impaired children also exhibit speech Impairments. A 
prnfounrily deaf sample should" not be described with a secondary 
handicapping condition of speech/language Impaired since this Is a 
generally accepted concomitant condition with profound deafness. Avoid. 
■Klnq *M M ■ combination unless It Is Impossible to Identify a predominant 
primary or secondary handicap. 

0 « None - Use to code secondary handicapping condition Hem (AC) when 100* 

of the sample displays the primary handicapping condition and/or there 
Is no secondary handicapping condition. 

1 » Molt (handicapped - concomitant Impairments (such as mentally 

retarded-blind, mentally ret arded-or t hoped leal 1y Impaired, etc.), the 
combination of which causes such severe educational problems that they 
cannot be accommodated In special education programs solely for one of 
the Impairments. Include deaf blind In this category. Do not Include 
handicapped children whose only second handicap Is a mild speech or 
language Impairment, or dlsadvantaged/hlgh risk children who are also 
MR, or hearing Impaired, or orthopedlcally Impaired, etc. 
? ■ Hearing Impaired - a hearing Impairment which Is so severe that the 
child Is Impaired In processing linguistic Information through hearing, 
with or without amplification, which adversely affects educational 
per formancc. 

.1 - Visually Impaired - a visual Impairment which, even with correction, 
adversely affects a child's educational performance, the term Includes 
hoth partially seeing and blind children. 

A = Mentally Retarded - significantly suhaverane general intellectual 
functioning existing concurrently with deficits In adaptive behavior 
and manifested during the developmental period, which adversely affects 
a r.hlld's educational performance. Oo not Include autistic children In 
this category. If article states that all children were Down Syndrome, 
assume they are also all MR (depending on severity, some may he coded 
mutt (handicapped Instead of MR). If IQ Is In MR range and adaptive 
behavior Is not mentioned, assume sample Is still MM. 
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5 • Speech/Language Impaired - a communication dlsordtr, such as 

stuttering, Impaired articulation, a lanouage Impairment, or a volet 
Impairment, which adversely affects a child's educational performance. 
Oo not Include In this category If primary handicapping condition Is 
hearing Impairment, autism, or cerebral palsy. 

6 ■ Learning Disabled - a disorder In one or more of the basic . 

psychological processes Involved In understanding or In using language, 

spoken or written, which may manifest Itself In in Imperfect ability to 

listen, think, speak, read, write, spell or to do mathematical 

calculations. The term Includes such conditions as perceptual 

handicaps, brain Injury, minimal brain dysfunction, dyslexia, and 

developmental aphasia. The term does not Include children who have 

learning problems which are primarily the result of visual, hearing, or 

motor handicaps, of mental retardation, or of environmental, Cultural, ' 

or economic disadvantage* 

7 "Orthopedlcally Impaired • a severe orthopedic Impairment which 

adversely affects a child's educational performance. The term Includes 
impairments caused by congenital anomaly (e.g.* clubfoot, absence of 
some member, ttc), Impairments caused by disease (e.g., poliomyelitis, 
bone tuberculosis, etc.), and Impairments from other causes (e.g., 
cerebral palsy, amputations, and fractures or burns which cause 
contractures)* , 

n ■ Other Health Impaired - limited strength, vitality or alertness, due to 
chronic or acute health problems such as a heart condition, 
tuberculosis, rheumatic fever* nephritis, asthma, sickle cell anemia, 
hemophilia, epilepsy, lead poisoning, leukemia, or diabetes, which 
adversely Affect* a child's educational performance* 

9 « emotionally Disturbed - exhibiting one or more of the following 

characteristics over a long parlod of time and to a marked degree, 

which adversely affects educational performance! an Inability to learn , 

which cannot be explained by Intellectual, sensory, or health factors; 

an Inability to build or maintain satisfactory Interpersonal 

relationships with peers and teachers; Inappropriate types of behavior 

or feelings under normal circumstances; a general pervasive mood of 

unhapplness or depression; or a tendency to develop physical symptoms 

or fears associated with personal or school problems. Includes 

children who are schliophrenlc or autistic. The term does not Include 

children who are socially maladjusted, unless It Is determined that 

they are seriously emotionally disturbed. Children referred to as 

hyperactive, hyperkinetic, or Attentlonal Deficit Disorder (ADO) should m 
be included In this category. 

10 ■ General Developmental Oeiay - this Is usually used with very young 

children who have delays In more than one area of development, e.g., 
language, motor, cognitive, social -emotional, self-help, it is used 
when other labels are not clear-cut and definitive. Do not use as 
secondary handicap. 

11 « High Risk - Includes only children determined to*e at risk of being or r\> 

becoming handicapped because of medical (e.e., low birth weight* • 

perinatal trauma), or genetic (e.g., mother MR) reasons. Do not use as 7 1 ; 

secondary handicap. eft 

! 
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1* • Disadvantaged - subjects from poverty! culturally or socially 
ilisatlvantaqeit settings. Do not use as secondary handicap. 

1.1 - Other. If children In a sample exhibit a handicapping cnndltlon which 
is not clearly Included In one of the ahove codes, code It as "Other" 
and soeclfy the particular kind of handicapping condition. Before 
ustnq this code, see Glendon or Karl to make sure the handicap does not 
fit In one of the extstlnq codes. 

M * Combination 

4. X Minni'ttv In Samole 

rode the percent of the sample Milch fall Into each of the following 
minority nrouos. Oo not assume that all children In the SMple are from 
Ui* particular minority group which Is associated with a specific city, 
for ruAnple, It would be erroneous to assume that an Intervention 
population In Inner city Atlanta was 1001 Black, or that a sample from 
Albuquerque, Not Mexico was 100ft Hispanic, unless that Information Is qlven 
in the article. 

A. t Black - oercentaqe of children In sample at time of post test who are 

Black. 

B. X Hispanic - percentaqe of chldrin In sample at time of posttest who 
are Hispanic (Includes Mexican-American, Puerto Mean. Cuban, etc.). 
Assume Spanish bilingual programs are 100ft Hispanic. 

C. ft other Minority - percentage of children in sample at time of posttest 
who are Native American, Southeast Asian, or other minority group 
(particularly where English Is a second language) other than Black or 
Hispanic where minority group membership might be related to 
Intervention success. 

10. Geoqraphtc Setting: 

I * Inner city - sample population drawn from "core, Inner city" of a 
metropolitan area having at least 100,000 Inhabitants. Note: The 
determining factor here Is not that the Intervention took place In an 
area having more than 100,000 Inhabitants but rather that the 
participants came from the "core, Inner city" of an area having at 
Ina&t 100,000 Inhabitants. 

7 » city/suburban - Samole pnpulatlon drawn from cltv or suburban area with 
10,000*100,000 Inhabitants. 

.1 * rural /reinnte - sample drawn from rural/remote area which Is more than 
45 minutes normal travel time to a city with more than 10,000 

inhabitants. 

4 « mixed - If sample population Is not predominantly drawn from one of the 
ahove defined IncatlonS but Includes subjects from 2 or more. 

fn.tr this Iten "2 ■ city/ suburban" unless the article gives specific 
infnrmatlon which convinces you to code 1t "I", "3", or "4". If author 
refer*, to sample as rural or Inner city and ql yes no other I nf or mat Ion , use 
the author's definition. ■ To he considered a mUed qeonraphtc setting, at 
least Inx of the simple must be In each of two groups. 
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11. Target Child's Family Characteristics 

A. Percentage from one-parent homes: percentage of sawtle at time of 
posttest -her. either th. father or mother Is not present In the home 

• Jfcentage " th father present In the home: percentage of sample* 
time of posttest with the father present In the home. W 

' of children In home: average nuebcr of children living 

0. Mothers: average number of years schooling completed. Oo not count 
kindergarten (e.g., If article states that the average. Mount of 
schooling was eighth grade, It should he coded 1.0). If the article 

2m ft W W 1 * •* »»»• «• *** ■•"«» W «f 
* estlMate of c od t (e.g., If highest grade completed In the samole 
was eighth, article should fie coded 1.0 - |t - [.27(81]). W 
m n^I " ,r ; 9 ! 5 u *«:, of Khoollng completed-'code same as 
II '"I 0 "". 1 ' 0 " u •■»•» *"y ?or parents", assume both 
■other and father have the same Mount of education and use the same 
number for ll-D and JM. if inflation Is given only for moThsr, do 
not assume anything for father and vice versa. ' 



III. IHTCMCHTIOh 



j. ,'ir S - 1 J. c ? d ' d " ! " CdWtatftal »«. control), "3" (pre-post 
unadjusted). "4" (pre-post adjusted), cr "S" (slnele subject design), the 1 ' 

C Uix°l ^^^S?'l? , U "f. ta 5 M » l ! cUo ° '^Id * coded 

If ll-S s coded "2" (Intervention A vs. Intervention g), the control group box 

for all Items In this section should have a ember or There are sW 

U^EiLI' e ;j! , r! ,, ' wt41 * »»: JMperlmental • comparisons where H- Is 
appropriate. These art noted below. 

1. Mean Age of Child at Time Intervention Was Initiated (months) - record the 
age of the child at the time the Intervention progrM was begun. Precise 

i?°!!# h f:- M i ?i U * 11 th « th*» Intervention was begun when 

Immediately after birth, estlMate 0 months. Assum children begin 

kindergarten at 66 months and use this as an anchor point for other 

estimations. Do not estlnajte unless you are confident that the estimation 
Is within ♦ or - 3 months. 

2. Setting refers to letting nhere the target child received Intervention. 

• "Intervention" Is defined as any planned set of activities, Instruction, or 
environments change which Is Intended to produce gains In one of the 
outcMe domains defined In Section V. 

1 - Intervention Is delivered only In home setting, Including foster hone. 

2 ■ Intervention Is delivered only In nonresidential "center -based" 

settings (Including llaad Start, public school, day care, university, 
state social services agency). 

3 - Intervention delivered In any residential Institution, hospital, etc. 

4 ■ "Outpatient" services delivered In a doctor's office, clinic, or other 

center. This Includes children who attend a center defined In #2. but 
only for speech or physical therapy and do not participate In a total 
educational progrM. 

5 - Other 



6 * Intervention Is delivered In home- and center -based programs. In this 
case, •center" Includes Intervention delivered In any of the settings 
defined hy codes 2, 3, or 4. Estimate percentage of time per Meek on 
the average Intervention Is delivered In the home and In the center, 
e.g. v Home • 75%/Center » 251 would be coded for a program In which 15 
hrs/wcek was In the home and 5 hrs/week was In the Center. 

If 90* of the Intervention Is delivered In a •center* (codes 2, 3, or 4) t 
then the Intervention should be considered a center -based p roar am. To he 
considered a home-based program (I.e., coded as either t or 6), specific 
components of the Intervention totaling more than 10* of the total 
Intervention must be delivered at home. Typical parent communication and 
PR activities such as parent-teacher conferences, tours of the facility, 
notes to parents Informing them what the school did this week, etc. should 
not be considered as a home-based component of a program. 

Deqrec to Which Intervention Was "Tailored" Within the Sample Based on 
Diagnostic or Demographic Information 

1 * No particular "tailoring" of intervention. 

2 > Intervention somewhat tailored^ to unique needs of different 

Individuals. 

3 • Intervention substantially "tailored" to needs of different individuals. 

Refers to the degree to which the intervention Is different for Individual 
children based on demographic or diagnostic information, for example, do 
all children receive basically the s«r.e curriculum materials In the same 
sequence, or is the curriculum and sequence adjusted depending on each 
child's current level of performance, type of handicapping condition, etc* 
An Intervention which 1s child-directed wtjere the particular Intervention 
experience the child receives may be very different from what other 
children receive, but these differences result from child decisions when 
the same materials are available to all should be coded "1", even though 
the nature of each Intervention may be different. Oo not confuf : this Hem 
with Item 111:8-8 which codes the degree of structure In the curriculum, 
this Item refers only to the degree to which the Intervenor Is making 
cu) r IcuhWscqiicnclng/therapeutlc decisions based on the unique needs 
and/or perceived level of functioning of the child. This Item should be 
codod "2" If some of the intervention but less than half of It Is 
determined based on some assessment or diagnosis of Individual children. 
If more than half of the Intervention Is structured as a result of 
Individual assessment diagnosis, It should be coded "3". 

Involvement of Various Intervenors with Child. 

Tor each of the categories (A-F), note whether people In that category had 
snip, major, minor, or no Involvement with the Child In the Intervention 
program, Ho not Include administrative, supervisory, or training 
activities In determining a person's Involvement with Intervention. 
Consider the following examples to represent "only Intervenor" Status: 
I) a teacher conducts a center-based program which parents visit 
occasionally hut no structured programs are given to parents and there are 
no foimal expectations for them to assist with the Intervention; 2) a 
parent Is trained In how to deliver intervention and receives supervision 
and "tnscrvlce training" but no one else actually works with the child. To 
he considered a "major Intervenor 11 , a category of persons must have contact 
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with the target child 25X or more of the total intervention time. A "minor 
intervenor* would have contact with the child less thin M of the to^al 
Intervention time. To be considered a "minor Intervenor", there must be 
some expectation for the person to perform specific Intervention-related 
tasks on the part of the major Intervenor. In addition, to be considered * 
"minor Intervenor", persons In each of the Intervenor categories must 
participate in a minimum totel amount of the intervention as defined 
below. 

A. Parent or Family Nemberi 10% 

B. Teacher: lot 

C. Aide, Tutor, or Assistant: 20* 

0. Support Service: No Minimum percentage as long as it Is e structured 

role with expectations. 
C. Medical: lot 
F. Other: lot 

For example, a parent wto accompanies the child occasionally to a . 
center-based Intervention program would not be considered a minor 
intervenor unless the texher of that program has specific expectations for 
the parent to be Involved In the program, there is some Indication that the 
parent meets those expectations, and the parent role constitutes at least 
lot of the total 1ntervent1oo« In ether wtords, it Is not sufficient to sty 
that the parent was present during various Intervention sessions and 
consequently may have modeled some of the teaching behaviors in the home 
even though there was no tpeclflc expectation for that home teaching. If 
any of the categories are coded "3 • only intervenor", all other categories 
should be coded "0*. There can only be one category coded "2 • major 
Intervenor". In other words, you mult decide which category Is the primary 
Intervenor. Otto categories participating In the Intervention according 
to the uMldetlnet above should t*t coded "1 « minor Intervenor". If two 
categories were total time of Intervention equally, code as the major 
Intervenor that category which has primary responsibility for planning or 
supervising the Intervention activities. A teacher (category I) Is defined 
as any professional person who Is not a parent or family member who has 
primary responsibility for a child or group of children in an Intervention 
program. In other Mtrds, * graduate student might be a teacher 1n one 
progrim if they are Ihe person with primary responsibility, but may be 
coded as an assistant 1n another program where they are working under the 
direction of a head teacher. 

Training of Intervenors 

1 - professionally cert 1r ted for rold and 24 hours* training. For this 

Hem, the H hours* training refers to training specific to the 
Intervention program being I wanted. This Item would be coded, for 
example, wh^n a ketcher 1| the primary Intervenor with the Portage 
Program and has attended at least a three-day workshop or three days 
worth of Inservlce training on using the Fort toe materials. 

2 • professionally certified for role **d no training specific to program. 

This Item would be coded If In £he above Situation the teacher was 
simply provided with the Portage training materials but there wal no 
structured Inter v let training or workshop associated with It, The 
teacher read the materials, prhapt Including a teacher's guide, and 
then Implemented them. 
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3 « not professional certified for role, 24 hours* training to program. 

Thts Hem should be coded when a paraprofesstonal or parent Is the 
primary Intervenor but they hive been given it least 24 hours of 
training specific *Uy In how to Implement that particular Intervention 
program. A parent who has completed 'a Portage workshop for at least 
three days on how to Implement the program would be counted In this 
category. 

4 * not professionally certified and no specific tralnlnq for program* Any 

parent, aide, or graduate assistant who has not received at least three 
riavs of specific training for the program being Implemented. 

rV) not estimate Information for this Hem. In other words, do not assume 
that all Mead Start teachers are certified teachers because the teachers 
with who* you worked 1n Head Start were mostly certified. Do not assume 
parents dn not have any training unless that Information Is contained In 
thn article. For most programs, the area In which professional 
certification* 1s needed will be clear (e.g., educational programs need 
teachers, medical programs need doctors or nurses, physical therapy 
programs need physical therapists). However, In a few Instances, It may 
not he as clear. For example, a vestibular stimulation program does not 
require a qreat deal of training In physical therapy to be correctly 
tmptctocntcd. In such cases, however, you should still regulre that a 
person he professionally certified by the .discipline which generally 
Implements such Intervention programs before coding It a or a 

Duration of Child Focused Intervention 

A, Average Hours of Child focused Intervention Per Week 

Only include activities which directly Involve the child In Intervention 
activities. For example, a child may be In a hospital 24 hours/day for 6 
days and receive therapy for 1/2 hour /da v. This Item should be coded 3.0, 
not 144.0 (6 X 24). Be very careful about estimating In the absence of 
explicit Information because even s*a11 errors. can seriously distort the 
total when they are magnified over * long time period. For example, a 
10-wnck proqram might easily Involve 60 hours of Intervention (2 hours/day 
x .1 days/week) to 40O hours of Intervention (8 hours/day x S days/week). 
Pccause both levels of Intensity are reported In the literature, It would 
be unacceptable to estimate by saying that a "typical" kindergarten runs 
for 4 hours/day. Unless more specific Information Is given, this Item 
sho.ild be coded blank. Do not estimate how much time parents Spend each 
dav In a home Instructional program unless such Information ,ls given* 
Also, Hn not estimate the amount of home-used Intervention If the article 
reports only Information such as parents w.re expected to work with their 
r N • lit dally. Mote that for home-based programs, you are coding the 
Intended time of Intervention. If the article states that parents were 
expertH to work with their child for 30 awutst each day five days a week, 
you should record 2.S hnurs per week and 'her. also code under Item 111-16 
I he degree to which the treatment was Implemented as planned. If the 
article States that parents work with their children dally, assume that 
parents work with their children for S days a week unless other Information 
is given. 

ft. lair at Inn of Child Focused Intervention In Weeks 

Only count time child Is actually in the specific setting. Assume that a 
"full ynar" program Is 9 months long with 4. 3 weeks/month unless specified 
otherwise. Assume! nondiversity center-based programs are on vacation for 
7 weeks at Christmas and 1 week at Caster, unless otherwise specified. 



Assume university center-based programs are on vacation 2 weeks at 
Christmas, I week at Easter and 3 other weeks between September t and June 
I. Assume home-based programs do not function In the absence of some type 
of supervision or monitoring unless reported otherwise. For example, If a 
home-based program functions from September I, 117/ to Hay 30, 1979 but 
parents receive no assistance or supervision during the summer of I97§< 
(June 1 - August 31), that would be a 77-week program (IB months x 4,3 
weeks/month • 77.4) and not a 90-week program (21 months I 4.3 weeks/ month 
- 90.3). 

C. Total Hours of Child Focused Intervention In Weeks 

Information for this Item will be computed using the Information recorded 
In Hems UI:6-A and 111:6-1 and follows the basic conventions outlined 
above for determining I cf hours. 

Node of Intervention 

1 ■ Educational - Intervention It aimed at developing those cognitive* 
linguistic, social /emotional, or physical/motor skills necessary for . 
optimal societal adjustment (Including school performance). 
Intervention may also be aimed at skills which com* as logical 
precursors to those skills mandatory to societal adjustment. To be 
con I I Je red an educational Intervention, the program must Include 
activities such as vocabulary development, letter Identification! 
number Identification, matching! manlpulatlvos, or the mastery of other 
cognitive-related tklilt and concepts which are obvious orecursort to 
academic tasks suth as reading, arithmetic, writing, or language. 
• Virtually all early intervention programs are designed to Impact at 
some point on the chlld't educational performance. However, they 
should not he considered In thts category tiniest they meet the 
guidelines above. Speech/therapy programs should be considered at 
educational Intervention. 

i ■ Hedlca! - iny drug or therapeutic Intervention designed specifically to 
ameliorate or facilitate the physical health, functioning, or well 
being of t e child except for Interventions coded as "4* below. 
Include In this category occupational therapy or physical therapy 
programs. 

3 ■ Setting Change - the movement of the child from one milieu to another, 

or a substantial change of the child's milieu without an accompanying 
educational, medical, or therapeutic Intervention. 

4 ■ Stimulation - the deliberate exaggeration (amount or frequency) of 

sensory stimuli or stimuli to other physical modalities such as the 
vestibular canals. This category should only be coded when the primary 
focus of the Intervention Is stimulation for the sake of stimulation, 
and not when stimulation occurs as a natural by-product of some 
educational Intervention. Interventions will usually only be coded In 
this category when the target child Is an Infant or functioning at the 
developmental level of an Infant. These Interventions are primarily 
environmental enrichments such as stroking babies, flashing lights, 
vestibular stimulation, surrounding the child with various sounds, etc. 
Obviously* every Intervention component Involves stimulation of some 
type. If you are In doubt about whether to code an Intervention as 
stimulation or one of the other five categories, see Karl. 

5 • Diet - a deliberate adjustment of food Intake In order to ameliorate or 

facilitate a physical or nonphysleal condition. 

6 ■ Other - Doman-Delecato or other types of "sensory Integration" 

therapies should be ended In this category and a specific note made 
desert n the type of therapy. 



linns lll:fl-A • Ills H*P should only be ended If 111*8 wis coded 
"1 * educational". Even thonqh AA-flf) cnuld be construed to apply to some 
medical and stimulation therapies, do not code for anything but educational 
intervention without chock I nq with Karl. 

fnr educational Interventions 

A, Was a Specific fducatlonal Curriculum Used for Majority of Intervention 
Activities? 

Rernrd the namc(s) of any specific curriculum which Is used for majority of 
intervention activities. This Includes commercially available and other 
standardised curricula. For example, Portaon 1s now commercially 
available, hut before 1t was was marketed It wis still a specifically 
defined standardlicd curriculum. Tq be considered a primary curriculum. It 
most he used for A0< or more of the Intervention proqram. Use the 
following guidelines In codlnq. 

An ediicatinnal Intervention should be considered a specific currlc lum If 
it contains a scope and sequence of Instructional activities and It 
available In a written, self-contained form. A professional Inttrvenor 
should he able to implement the program based on the Information In the 
nacUqe, with only minimal outside training. An intervention procedure 
which is explained In qreat detail and Is very repllcable may or may not bo 
a curriculum according to this definition. 

R. Deqrec of Structure In Curriculum 

1 « Very Structured - SOX or more of the Intervention must be based on a 
detailed set of outcome objectives supported by a task analysts with 
scripted presentation of activities and procedures and criteria for 
proqresslnq to new material. 

7 * Somewhat Structured: 50* or more of the Intervention must be organised 
around preconceived activities which Is based on explicit scope and 
sequence of learning. The relation of various parts of the curriculum 
should he specified and there should be the Intention for Intervention- 
ists to follow a preconceived, orqanlicd plan of Instruction. 

J * Not Structured: any Intervention which does not meet the criteria for 
1 or 2 abnve. 

U nart of the proqram Is very structured and part of It Is not, code the 
it mb M - H unless one deqree "structure" accounts for AO* or more of the 
total proqram. 

C, Control of Instructional Activities 

1 * MoMly child controlled - should he ended whenever the child's 

iter, isions (as npposed to symptoms or current level of functioning) are 
(he nalor factor In determining the content or sequence Of the 
intervention. This Includes situations In which after the learnlnn 
environment has be*n orqanlied h.v the teacher or Intervenor with 
appropriate materials ami experiences available to the child, the child 
then enerclses his/her own volition In setecttnq and Interacting with 
these materials. 

? ■ Mostly Intervenor controlled - not only does the teacher select and 
rnntrnl the materials available to the child, but l/he also outline! 
the sequence and mode of usage. The Intervenor makes decisions 
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reqardlnq paclnq, selection of activities for a certain session, Oien 
to beqln and end. For this Item, the word "teacher" Includes parents, 
assistants, support personnel, or any other person Involved In 
directing Intervention activities. 

0. Focus of "Educational" Intervention 

For each treatment group In an educational Intervention, Specify Oilch of 
the followlnq Is most descriptive of the total program. In comparisons of 
a true experiment and control qroup, the control qroup should be coded "N". 

00 not code this Item unless It Is an educational Intervention without 
first checklnq with Karl. 

1 - Language - Expressive and receptive language skills (listening, 

speaking, writing, signing) or articulation. Vocabulary development. 

2 • SelMlelp/O.T. - Health/hygiene, eating, grooming, housekeeping, (dally 

living), dressing, toileting. mk 

3 ■ Mo tor /P. T. - Fine and gross motor skills, physical fitness, 

visual-perceptual skills, body awareness and posture; sensorimotor. t 

4 « Social-Emotional - Self-concept, social skills, peer and adult 

interaction strategies. 

5 - Behavioral * Discipline problems, disruptive behavior, self- .. 

abusive/ Injurious behavior. 

6 • C ognitive Ipre-acadcmtc) - Development of skills necessary for 

acquisition of reading, math, and functional literacy. Will generally 
Include letter and number recognition, matching and Identification 
e*erctes, following directions, word games, etc. 

7 - Combination of 2 or more of the above as major foci of Intervention. 

8 ■ Other— specify ^ ; . . 

I. Old Program Use a Stated Theoretical Approach! If the article refers to a 
particular theoretical approach or type of curriculum upon ditch the 
Intervention was based, code this Item "1 - Yes" and specify the particular 
type of theoretical approach utilised. Examples of such theoretical 
approaches Intludf Flagetlan. Direct Instruction, Doman Oelacato, Betel 1, 
Operant Conditioning, etc. Be as specific as you can be In a short amount 
of space In providing specifics about the theoretical approach. Also, 
renember to copy and attach to your coding sheet for later analyses copies 
of the paqes In the article which describe the Intervention and the 
theoretical basis upon whlch.lt Is built, If any. 

10. Treatment Delivered lot 

1 ■ parent only , 

2 - child only 

3 ■ parent and child together 

4 • parent and child separately 

5 - both parent and child but not clearly 3 or 4 

tiule ht 4 U both parent anri child receive any amount of intervention from 
proqram personnel, go to Bute B. If not, code either II or is. 

Rule B: If parent and child are together 15* or more of either child fv> 
Intervention time or parent Intervention time, code u. I 
Otherwise, code 14. 7 1 
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Fxtmpln 1: In a stimulation program for blind Infants, parents receive 4 
hrs/weck lecture and bring their child In for 1 hr/week during 
which they practice certain techniques. It Is assumed that the 
child receives some direct attention by program personnel. Code 

because for 100* of Intervention with the child, parent and 
child were together. 

Tipple ?; In a similar program, parents receive 4 hrs/wcek lecture while 
the Infants are In an Intervention program nursery, for 30 
minutes per week, they are ieen tonether. Code M because the 
time Parent and child were together was less than 15* of either 
child or parent Intervention time. 



In Section III: Intervention, thera are several Items which orovlde Imormatlon 
,ibout specific components of an Intervention. If an Intervention does not 
Intend to Include that component at all, Items related to those components 
should he marked U N*. For example, an Intervention treatment which does not 
tnxliirfp any parent training should be coded "N" and not 0. Items In Section III 
to which this rule always applies Include Items 6 and 7 (child-focused 
Intervention); In cases where the total Intervention Is focused only on the 
parent*, Items II through 13 (parent training); where the Intervention does not 
plan lo provide any home-based tr Inlng, Item 14 ("home-based- Intervention 
components); and where no "center- based" Intervention Is Intended, Hem 15 
("center-based 11 Intervention comoohents). 

11, for Parent Tralnlhq Components 

A. Averaoe Hours of Parent Training Per Week 

Parent training consists of any Intervention activities which are designed 
to Increase the parent 1 ! ability U asiltt ti.elr child In Mklng 
developmental progress, better cope with hiving a handicapped child, better 
access services for assisting their handicapped child, become wtter 
informed about the nature of the hanJlcapplna condition u their children s 
eipKted development, or other activities which are Intended to directly or 
Indirectly prevent, ameliorate, or ellnlhUe a handicapping condition In 
their child. Assume all parents attended all formal training sesslnns 
unless other Information Is given In the article. Do not count time 
parents spend delivering home-based services as parent training time. 
Allhounh they may become better Interventionists during this time is a 
result of practice, this should be considered service delivery and not 
parent training. 

n, Duration of Parent Training In Weeks 

rorte tho num!ier of weeks from the beginning of parent training to end of 
pare"*, training In which some forma) training occurred each month. In 
other words, If oarents had a monthly workshop for \2 months, this should 
ho rortM weeks, if parents had workshops once each week for 4 months 
an-i thnn one wort. shoo a week for 3 weeks, this should be coded 20 weeks 
(4. J X 4 ♦ 3 • 20.?). If, however, parents had a monthly workshop for 3 
months and then had r,o activity for 3 months at which time they had a 
monthly workshon for 3 more months, this should he coded 76 weeks (4,3 
necks X 6 months). Do not count any time In which at least one training 
activity per month did not occur. 
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C. Total Hours of Parent Training 

Estimate as near as you can the total hours of parent training which 
occurred. Mote: This will not be a strict computation of 11 and 12 
because parent training frequently does not occur on a regular basis as 
noted In Item Ill-l?. 

For "Home-Based" Intervention Components 

Information In this Item should be coded for any component of any 
Intervention program which Is conducted In the home as opposed to some type 
of "center". The primary Intervener In such Settings will often be a 
parent, sibling, or other family member assisted by a teacher, speech 
therapist, nurse, or other professional or paraprofesslonal person* 

A. Average Number of Visits Per Month with Parents or Family to Supervise/ 
Assist with Home-Based Training - code the average number of times per 
month over the duration of the Intervention period In which agency 
personnel were In the home of the family to supervise/assist with 
home-based training. Do not count visits which parents made to the . 
center or telephone or written contact made with the parents. To be 
counted as a visit, agency personnel must be physically present In the 
child's home. 

I. / or age Hours Per Mofrth Spent with Parents or Family Member to 

Supervise/Assist wit's Home-Based Training - code the average hours per 
month over the duration of the project which agency personnel spent In 
the home to assist with home-based training. Assume that a "brief 
visit" Is 1/2-hour long If no other Information Is given. If article 
states only that periodic visits were medej leave this Hem blank. If 
the article states that a oe**hour visit was made to each home weekly 
for the first three months of tht program and no visits were made for 
the remainder of the program and the program lasted 9 months, the item 
should be coded for 1 hour X 4.3 weeks X 3 months ■ 13 hours • 9 
months - 1.4. In other words, the Information asked for Is the average 
Hoots per month spread over the life of the Intervention program. 

C. Nature of the Home-Based Program 

1 ■ Parent training - the parent Is trained as an Intervention agent by 

the home teacher. The parent Implements systematic educational 
intervention activities (Including language, PT, Of, cognitive) 
with their child. 

2 ■ Home tutorial • the horn* teacher visits the home and Implements 

systematic Intervention activities with the child. The parent may 
or may not be present during the activities. 

3 • Material/toy library - parents are provided with materials, toys or 

tfdUUU* to titfkMul wltfi their dilld. These could be accompa- 
nied by activity guides, phone follow-up or home visits. Primary 
emphasis Is on provision of material Instead of a systematic set of 
educational or therapeutic Intervention procedures. 

4 • Health/social service Intervention - parents and/or children are 

visited by a nurse or social worker or trained In accessing health/ 
social services. The puroose of the program Is for assistance In 
noneducatlonal activities such as nutrition, child care* child 
development* , 

5 ■ Combination - any program which Involves major portions (I.e., 25< 

or more of the total Intervention progr**) of two or more of the 
above. 



It. Did patents hive written program describing weekly lesson Activities? 



1 ■ Yes - Code If article describes a written program which Is provided 
to parents which describes the activities they are supposed to do 
with their children each week. To be considered a written program, 
It must describe At least AOt of all activities parents are 
supposed to conduct with their children. 

0 • No - If no mention Is made of a written nrogre* being provided, 

code this Item "No". 

I. For Center-Rased Intervention Components 

A, Child/lntervcnor Ratio (--): List the number of children per 
Intervener In the treatment location over the course of the 
Intervention, for exanple, If & program for 10 children has 1 teacher 
all day And 1 aide for 1/2 day, the ratio Is 10 to 1.5 ■ 7, not 10 to 2 
• S. Although a pronram may be designed to provide Individual lied 
Instruction, how oany children are present with the Intervention 
anent(s) at a given time? 

ft, Percentage of children receiving prior home-based Intervention (---): 
Percentage of children In the treatment proqram who participated In a 
dome-based Intervention program prior to the center-based Intervention 
be I no coded In this comparison. 

r, Mree of "target* child svgr.egatinn: 

Ihls Hem codes Information about the degree to which the Intervention 
tuok place In a homogeneous group of handicapped children, versus a 
heterogeneous group of handicapped children, versus a heterogeneous 
group of handicapped and nonhandlcapped children. In other words, It 
Is asking a question about the degree to which the Intervention 
occurred In a malnstr earned or nonmalnstreamed setting. The following 
Information should be used to code. 

1 ■ Target children— generally same type and severity - Homogeneous 

qroup of "handicapped" children all with same type and severity of 
handicap together In the treatment program. Includes programs 
which provide one-to-one Intervention, because In those Settings 
children are segregated from other children. 

2 - Target children, various types and severity - Heterogeneous group 

of "handicapped" children with different types of severity of 
handicap tooether In the treatment program. 

3 - Integrated with nonhandlcapped - Heterogenous group of 

"tHndtcapped'/nonhandlcanped children together In the treatment 
program. The ratio or handicapped to nonhandlcapped should be 
filled In If the Information Is given. 

4. rvqrre to Which Treatment Was Implemented as Planned 

In most eases, little Information will be provided ahout this Item. 
Because of Item IS below. It Is okav to estimate when no Information Is 
■liven. Srr** number should always be coded for this Item. 

I » tnUl experimental treatment Implemented as planned! From the 
persnectlve of a critical project director, was almost everything 
Imp I Alien ted as he/she would hive hoped? Programs which are well laid 
out with adequate supervision and are appropriately focused, or where 
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very little extraordinary Is expected from the Intervention agent In 
terms of skills and/or commitment, are most likely to be Implemented as 
planned* For example, an Intervention of routine, physical therapy 
provided In a hospital setting by hospital staff already trained to do 
those functions and with some Supervision would probably be Implemented 
as planned* 

2 • Host of the experimental treatment Implemented as planned!. Although 

there were some weaknesses In the way the Implementation occurred and 
numerous areas In which Improvement could be made, there Is • clear 
difference between the Interventions received by the experimental group 
and a control group* For example, In a home-based program, It may have 
been Intended that parents would be trained so they could be as good an 
Ixylementor as the trainers* They may never have reached this level of 
proficiency; however, they were clearly delivering services tAlch were 
different from what a typical parent would be giving their child. 
Interventions which regulre extraordinary levels of coenltment or 
particularly complex training regimens should generally be coded In 
this category unless other specific Information Is given* 

3 ■ Only some parts of experimental treatment Implemented as planned! To 

be coded "3". there may still be differences between the experimental • 
1 and control group but there are major problems with the implementation 
so that this particular test of the implementation Is not a fair test 
of that intervention strategy* For example, If parents were Intended 
to deliver one hour per day of home-based intervention but there Is 
evidence to suggest that children only received an average of 1*1 hours 
per week, this would be a major problem with the Intervention* The 
degree to which an Intervention calls for skills or commitment tfcich Is 
not present in the intervener population or that the treatment Is a 
very complex treatment without necessary supervision or assistance will 
contribute to problems In this area. 

In some studies, they will have data suggesting how well the treatment Is 
Implemented. In other cases, you will need to make judgments based on your 
perceptions of the complexity end realistic nature of Implementing the 
treatment as planned. In some cases, you would judge from the "tone" of 
the article. In all cases, however, you should make the judgment and code 
this Itttn M"* "2", or "3", Protection for making bad guesses Is provided 
In Item 15 below. 

15. Information Source for Coding 111-14* 

1 ■ Adequate data presented In article to support coding of 111-16. 

2 ■ Author's conclusion or Implication but not adequately supported by 

data. 

3 ■ Coder's Conclusion based dn potential or reported difficulties of 

treatment implementation, amount of supervision given, and tone of 
article. 

1ft* Prior Formal Intervention History 

Information In this item refers to intervention received by target children 

prior to intervention which Is being described in the article being coded. 

If the article states that the Intervention Is belgg carried out with ^ 

infants shortly after birth, assume that they had no prior Intervention) i 

otherwise, require definite information before coding* 
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I ■ Definitely no 

.1 » Yes, 1-6 mos. 

4 > yi»s, 7-1? no*. 

fi » ves, 1.1 mos. or More 

Ihis Item should be coded for the cnntrol qroup even when type of 
comparison Is not th When the type of design Is I pre- post design, this 
Ite-i would be "not applicable" In the cell libeled control. 

17. 0*uree of Intended Parent /Family Involvement In Program: Listed below ere 
four categories of Intended fanlly Involvement. Remember, this Item Is 
coding what was Intended by the program developers, not what actually 
happened. For each of the four categories, descriptions Are given. Use 
the criteria In each of the categories for a general guide and Include the 
code In that category If most of the criteria for that category are net. 

1 • fxtcnsftve: For classroom Programs , parents are expected to volunteer 

In the classroom on a weekly basts and parents are Included In planning 
and evaluating classroon activities. The classroom teacher provides 
carryover activities weekly for parents to Implement In the home, for 
hwng^based programs , parents are eventually given responsibility for 
the planning, development, and delivery of Intervention activities. 
The parent acts as the child's Instructor * Minimum of 5 days a week, 
Implementing the planned Intervention activities. The parent 1s 
expected to record their child's progress In Intervention activities. 
Both: Parent' «re Invited to participate In program planning and 
evaluation activities. The pf-ogrw Involves parents In planning ami 
provides monthly Inservlce training and parent support meetings. 
Parents are active participants In developing their child's 
Intervention program. 

2 ■ Moderate: for classroom prog rams, parents are expected to volunteer In 

the classroom on a monthly or bimonthly basis. The teacher provides 
the parents with carryover activities to Implement In the home en at 
least a monthly basis, for home-based programs, the parent must serve 
as the child's Instructor a minimum or 5 days a week Implementing the 
planned Intervention activities. The parent Is expected to record 
their child's dally progress on Intervention activities, loth : The 
program provides regular Inservlce training and parent support 
meetings. Parents are Invited to review and make comments on their 
child's planned Intervention program. 

3 ■ Sone: For classroom progra ms, parents volunteer In the classroom 3-4 

times a year. Parents are provided with quarterly newsletters or 
quncr^l /generic carryover activities. For home-based programs , the 
parent Is presented activities during the home visit with the opt - xj of 
i rnpl c-r,ent tng them durlnq the week, hut primary home-based Intervention 
Is done by someone else. Both : The program provides general Interview 
training and occasional parent support groups. 
A * Hone: The parents are not involved In any aspect of the program. The 
howe-based program Is a tutorial and there Is no expectation that 
parents become Involved. 

\}\. parrnl /family Commitment/Cooperation Toward Intervention 

I * Very Positive: Parent Implements weekly Intervention activities with 
ihclr children, parents volunteer regularly In the classroom or program 
activities, parents attend and actively participate In parent training, 
parent, meetings, and program planning and evaluation. These activities 
arc implemented consistently with OOX or more of the parents. 
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2 • Positive! Parent participates In one or two of the following 

activities on a regular basis (at least 50* of the parents) 

• Implementing weekly classrooms or home-based Intervention activities 
with their children. 

• parents volunteer regularly In the classroom or program activities. 

• parents attend and participate In parent training, parent meetings, 
and program planning and evaluation, 

3 ■ Ambivalent/Negative: Parents do not participate In program activities 

other than mandatory activities. Program personnel often have a 
difficult time getting parents to participate In mandatory program 
activities. Article states that substantial number of parents were 
reticent to be Involved or did not complete activities. 

19. funding of Program 

1 ■ External funds for substantial portion - Use this convention for those 

Intervention programs where more than SO* of the funds come from 
federal or foundation sources. Unless there It clear evidence to the 
contrary, whenever an article acknowledges the contribution of a source 
of funds (e.g., this project wai supported by HCEEP Grant IMX), this 
code* should be used. 

2 ■ No or Insignificant external funding - Use this convention where more 

thai J>OX of the funds come from state and local resources* e.g., state 
education funds, social service funds, local funds, etc. 

3 - Probably no external funding • Use this code when there Is no specific 

mention of external funds and It Is not clear that there was no 
external funding. 

This Item should always have a number. I.e., It, should not be left blank. 

20. Continued Intervention Program After Preschool (0 • no, 1 ■ yes, 
definitely) 

This Item should be coded "N" for both experimental and control groups, 
except In those cases where an outcome measure Is collected I months or 
more after the Intervention stops, and children are S years old or older, 
for example, you would code this UrnTa It her "0% "1\ or ■-■ If an early 
Intervention program were conducted for children between 0 and 3 years of 
age and an IQ measure for children In the experimental and control groups 
was collected when the children were 8 years old. This Item 1s designed to 
collect Information about the conclusion of some reviewers that early 
Intervention programs are only effective If there Is a systematic 
deliberate program delivered to children In their regular education which 
Is compatible with the original early Intervention program*. 



Is. KSIGN 



I. Type 



1 ■ Random assignment - Subjects are randomly assigned to groups. When 

subjects are matched first on some varlau1e(s> and then randomly fo 
assigned to oroups, It should still be considered random assignment. I 

2 ■ Non-Random but appropriate matching on relevant variables • Not 7 1 

randomly assigned to groups but control subjects were matched to 

experimental subjects In such a way that It I; very likely that there to 
was less than 1/4 S.O. difference between the groups before I 
Intervention began on variables which were used as outcome measure. r\ r\rj t 
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Convenience or poor matchlnq - Basis for select Inq subjects wis that 
they wore available or matching criteria and procedures did not meet 
criteria outlined above. 

4 • Pre-post, no control - Estimate of Impact Is based on differences 

between pre and posttest scores on some outcome. There Is no control . 
nroup available and pre and posttest scores are not age-adjusted by 
referencing to norms. 

5 » Pre-post adjusted - Estimate of Impact Is based on differences In 

aqc-adjusted norms between pre and posttest. To be counted In tbls 
cateqory, tbe test must provide norm-referenced scores which are within 
I months of being appropriate for 90* or more of tbe children In the 
sample. For example, If the Bayley Scales were used In a pre and 
posttest setting with a group of children who average 1? months old at 
tbe beq Inning and 24 months old at the end, and scores are reported as 
standard scores or percentile scores using the appropriate norms for 
each o lid. the difference between pre and posttest scores would be an 
appropriate measure of outcome for this category since the Bavley 
provides norms at 3-month Intervals. This category can only be used 
when norms are provided with the age of child being used In the 
Intervention. Host I Q measures would be Included In this category. It 
does not apply when gains are reported In raw scores rather than 
percentiles or some other type of standard score. 

6 • Single subject - Data are presented as a graphic display of subject 

responses over time with estimates of Impact coming from differences 
between baseline periods and Intervention periods In either an "ABA 11 
type or "multiple baseline 4 type of design. 

7 « Crossover - At beginning of experiment, part of the experimental group 

jsstqncri to treatment condltlon(s) and part to control (or placebo) 
condltlon(s). After a time dependent measures are gathered for members 
of each group «nd treatment and control conditions are "crossed over". 
After a time, dependent measures are gathered again. This process ts 
repeated until dependent measures ire gathered for *ll members of 
experimental group as they are exposed to all conditions. 
A • Other - Any other design. Specify design on coding sheet. 

Blinding 

1 • Yes - Individual definitely blind. Article states that data collectors 

were blind or olves Information from which you can determine It, 

2 * Probably - Individual was not told the purpose of the study and/or What 

subjects were under what conditions but very possibly could have 
figured It out, or the article states that testers were Impartial or 
Independent but does not specifically state that they were blind* 

3 3 Probably not - Article does not give any Information about "blinding" 

of testers. Since "blinding" Is recognlied as such a positive 
procedure, we assume they probably would mention It had they done It. 

4 » Mo - Individual definitely was not blind. 

3. Presence of Factors which Underestimate Effectiveness of Early 

Intervention 

As described In the Campbell and Boruch article, there are numerous situa- 
tions In which an estimate of early Intervention effectiveness Might be 
undcrcst lifted when quasi -experimental deslqns are used. Host of these 
f it tors stem from a control group belnq used which Is more highly function* 
inn than the experimental group at tno beqlnnlnq of the Intervention 
liioiiiivn. When this happens, the following factors may lead to 
imderest Imatlons of the proqram Impact. 



a. Systematic under adjustment for pre-existing differences because of 
Inadequacies In analysis of covar lance adjustment procedures or 
regression toward the mean. 

b 9 Differential growth rates amonq populations functioning at different 
levels, Increases In reliability with age, and lower reliability In 
the more disadvantaged or lower functioning, group. In addition, test 
floor and eel line effects and what Campbell and Boruch referred to as 
grouping feedback effects (where the lower functioning group 
associates with other children who are low functioning and the control 
group or higher functioning group associates with other children who 
are higher functioning, thus contributing to exaggerating the differ* 
ences between the groups). 

The first four factors only occur when the control group li 
substantially higher functioning than the experimental group. As 
Campbell and Boruch pointed out! even though statistical adjustments 
were made In these situations, those adjustments will frequently 
under adjust. This Item should be coded on a 0-3 scale Indicating the , 
degree to which factors are present* which lend to underestimate the 
effectiveness of early Intervention. In one sense, this Is e coding 
of the degree to which the groups are divergent to begin with on the 
outcome variable, or variables related to the outcome variable with 
the control group being the higher functioning eroup* This should be 
coded "0" If It Is not a problem, "l"'1f some minor underestimation 
might occur (minor being defined as I tenth of a standard deviation or 
less, "2" If moderate underestimation might occur (moderate being 
defined as a tenth of a standard deviation to ,17 standard 
deviations), and "3" major underestimation (major underestimation 
being described as more than .67 standard deviation). The degree of * 
underestimation can be estimated to some degree from the severity of 
test floor and/or celling effects and regression towards the mean* 
Celling and floor effects will not generally be serious unless the 
effects are widely disparate for the experimental and control gre»f.. 
Estimations due to differential growth rates Increases In reliability 
with age, or lower reliability In the disadvantaged eroup are much 
more complex, but will generally only be minor effects by themselves 
unless the groups are widely divergent on the Initial measures (more 
than 1 standard deviation), or there Is reason to suspect radically 
different reliability coefficients In the two groups (different by 
more than .30). 

4. Threats to Validity 

Using the following general conventions, each effect site should be coded 
for each of the "threats" listed below using the following conventions. 
Be careful that coding Is honest, fair, and not overly harsh. In cases 
where there Is both an experimental and control groups contained In the 
study, a threat to the Internal validity of the study generally requires 
differential effect In the two groups. Obviously, children will mature 
over a year's time. The question of Internal validity Is Whether the 
process of maturation was different In the experimental and control groups 
so that It appeared that the treatment had an effect when In reality It 
was dlferent Ul maturation. 
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0 < Not plausible threat to Internal validity. 

1 * Potential minor problem In attributing the observed effect to 

treatment; by Itself, not. likely to account for substantial amount of 

the observed results. 
Z > Very plausible alternative explanation which could account for 

substantial amount of the observed results. Requires mce than Just a 

suspicion that something may have 9one wrong* 
.1 » Very plausible alternative explanation which by Itself could explain 

mos t or all of the observed results. Should be clear evidence of a 

major threat to the Internal validity of the study. 

V Maturation 

Biological, physiological, or psychological "processes within the 
respondents may vary systematically with the passage of time" but not as 
in* result of specific events external to the respondents, Examples of 
maturation Include growing older, more tired, better coordinated, etc. 
Suppose an experimenter claimed that a series of prescribed play 
activities were effective In promoting bladder control In Infants; as 
evidence he showed that 2% of the 15-month old Infants starting his 
experiment had control* and 75* of these Infants achieved control 9 months 
later. His claim Is questionable since the normal Infant naturally 
develops bladder control during this period. 

A. History % , 

Any events other than the experimental treatment that affected subjects In 
experimental and control qroups differently and Could have affected status 
on the outcome measure, History threats differ from selection threats In 
that with selection threats subjects In groups are different to begin 
with, with History threats subjects In different groups may be comparable 
to begin with but are affected differentially, by some external phenomenon 
during the course of the treatment* For example! 100 students are 
randomly assigned to an experimental English class to enhance writing 
skills or to a control English class with no particular emphasis on 
writing. At the end of the treatment, the experimental group Is superior 
to the control group In writing skills* But on closer examination we find 
that because of the school *s scheduling procedures, all students In the 
experimental English class also had social studies from a teacher who 
required weekly, writing assignments while those In Hwj control class had 
social studies from a teacher who required no writing assignments. Hence 
the differences In writing skills may have been attributable to the social 
studies class (which was not a part of the defined treatment) rather than 
the English class (I.e.. the treatment), 

f. , ?i? sting 

fhr effects of taking a test on the outcomes of subsequent administration 
of the some or a highly related test. Taking some cognitive-ability tests 
may Increase your score by several points on a second administration of 
t ho sane test or a parallel form of It, It Is unusual If two or three 
practice sessions on a test Increase a person's score by more than 1/4 
Mm\*r<\ deviation, for example this would be a threat If children were 
tested repeatedly with the same test Instrument on a pre»post design or 
children In the experimental group were repeatedly tested and children In 
rnntrot qroup were not, Another example Is wtion the treatment 
Inappropriately teaches to the test— is would be the case If the treatment 
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consisted of practice on the same types of activities as are Included In a 
particular Stanford-Binet subtest and th* outcome was the Stanford-llnet. 
Don't confuse appropriate "test content" w?$h "teechlni to the test", The 
above Is an example of "teaching to the test*. There fs nothing wrong ■ 
with selecting a test which appropriately neiiu.M the area In which your 
Intervention program was trying to create growth, *s long as you have not 
been teaching the same types or Hems that are on tht test. In other 
words, you can measure vocabulary growth In many ways* ff a program goes 
through a particular test of vocabulary competency, selects the words that 
are used In that test, and then drills children using those words and that 
format, and then tests them again four months later, 1t would be a serious 
testing threat* 

0, Instrumentation J 

Change* In the Instruments (tests. Judges, various measuring devices) with 
which persons participating In an experiment art observed nay produce 
changes In the scenes over time which are mistaken as treatment efforts* 
For example, Judges observing and rating some performance may b«r mort 
lenient from time 1 to time 2. Or children tested during the first day of 
a new school may not do so well as they would 2 weeks later after they 
become more comfortable with the new situations! Or two "parallel" forms 
of the same test amy emphaslie different skills differentially (e.g., 
vocabulary versus comprehension). Or • biased test administrator may 
consciously or unconsciously "fudge" results or be more positive for 
children 1n the experimental group. Individually administered cognitive 
tests by non-blind administrators almost always have some threat In this 
area* 

E. Statistical Regression 

The Inevitable tendency of persons who are selected because their scores 
are extreme (high above or far below the mean) on Measurement A to be less 
extreme (less hleh above or less far below the mean) on Measurement I. 
. When the correlation between A 1 1 Is less thin perfect, which for all 
practical purposes Is always. For example, regression towards the mean 
will be a threat 1f children In the experimental group were selected on 
the basis of an extreme score which was used simultaneously as a pretest 
and there was not a control Group or the control group was not selected on 
the basis of the same extreme scores, Regression will also be a threat If 
children are selected because they art deviant on a pretest and then are 
posttested on a completely different posttest, When children from 
substantially different populations are matched so that we have two groups 
of children who are the same on the variable on which the populations 
differ, there will almost a mays be regression hack towards the aeans of 
the respective populations, The maount of regression predictable Is 
easily calculated. If you have questions about how to do those 
calculations, see Karl. 

F, Selection Bias 

Subjects In the experimental and control group were* selected on different - rs» 

. bases In such a way that subjects In the two groups are not comparable on I 

variables that may be causally related to outcome selection bias. Includes 7 1 

alt of those factors which conspire to make the experimental and the t_i 

control groups unequal at the outset of an experiment In ways which cannot Ui 
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bOrojNirly ***** account In the analysis of the data. For example, 
'.electlnn might Invalidate a comparison of Curricula A anil K If older, 
mire experienced teachers were selected to teach the more difficult 
curriculum. In almost all Instances the host way to completely guard 
against selection Mas Is to have reasonably large samples and by 
wploylng the random assignment of persons or classrooms to treatments and 
then using statistical analyses of the final data which are based on the 
randwliatlon procedure. Quasi -experimental designs will almost always 
have some selection bias* 

Eiwlmcnta) Mortality 

Iho differential loss or "dropping out" of persons from two or more groups 
b*(no compared In an experiment. If attrition Is greater under curriculum 
A than curriculum 8 t a comparison of A and B at the end of one school year 
mlnht he biased In that the students* completing A would be brighten-on 
th<* average— than those completing B. This might occur because the slower 
undents were fatalities under curriculum A. The key Issue In whether 
o<p#r (mental natality Is a threat to the Internal validity of a study Is 
whether the attrition was systematic or random. If you have two groups of 
?S ntople who were randomly assigned to groups and each group loses 5 
students, the control grouo loses the top 5 students and the experimental 
nroup loses the bottom 5 students, this will obviously make It appear that 
Ibere are greater differences between the groups on the posttest than 
there really Is. Alternatively, If both groups lose their bottom 5 
students, the mortality has probably affected both groups about the same 
an I posttest differences between the groups will not be nearly as 
seriously affected. !f each group lows * random 5 students, the threat 
to the Internal validity of the study 1ft even less serious. As can be 
seen, It Is not Just an Issue of whether students were lost, but the 
characteristics of the students irfio were lost. 

Inappropriate Statistical Procedures 

Krfers to Inappropriate procedures used In statistical analysis ditch may 
affect the estimation of the effect site. Examples Include basing 
correlations on extreme groups, falling to account for serious 
disproportionate In an unbalanced ANOVA design, or using an 
Impropriate design. Another more Suhtle example of Inappropriate 
statistical procedures Is when you must base your estimation of effect 
sl/e on the probability or obtained t or f ratio and the researcher has 
u<rd an Inappropriate unit of analysis In analyilng the data (as would be 
thr case If classes were randomly assigned to groups and subjects were 
iiu-it as the unit of analysis). This would not he a problem If the article 
mportfd raw means and standard deviations. But when you must base your 
esilnatn of effect slie on a statistic that might have been Inflated or 
deflated using Inappropriate unit of Analyses, It would be a concern, 
tin M of analyses problems will usually only create minor threats. 

Oruriptlon of Sample 

Other 

doner al Index nf Validity 

Nnlr: the follnwtng table Is designed as a guide to establishing the 
giiipral Inrfwt of validity for a study. It was not designed to handle an 
possible combinat ions. If you are coding a study which Is not covered bv 
the guidelines nr seems tn contradict the guidelines, see Karl and/or make 
a note on tlin convent Inn e«panS lon/dlsagreement Sheet, 
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6. Adeguacy of Descriptive Information Information Provided About! 

A. Sample Description (subject variables): pertains primarily to Section 
II of the coding sheet and describes characteristics of the sample 
population. 

I. Intervention Description (treatment variables)! pertains primarily to 
Section 111 of the coding sheet and describes treatment 
characteristics. 

C. Design and Analysis Description (design variables)! pertains 

primarily to Section IV of the coding sheet end describes the design 
and analysis procedures employed. 

1 • Very Adeguate - Article describes the sample. Intervention, or design 
so that the experiment could bo replicated and you, is a reader, are 
confident about the procedures uhlch were used And the subjects which 
participated. Coding a *1" does not mean that there are no blanks In 
Sections II, III, and/or IV. If you code It »!•, there will typically 
not be very many blanks but more Importantly the Information which Is 
presented Is presented clearly and adeguately described to that you 
are confident about the Information which Is given. Of course, If 
there are many blanks In Sections II, III, and/or IV, a rating 
would not be appropriate. 

t ■ Partially Adeguate - essential pieces of Information are missing In 
categories II, III, and/or IV which would make It difficult to 
replicate the experiment unless additional Information Mere given. 
Additionally, what Information Is given suffers from some confuting 
presentation so that there art questions about what really did 
happen. 
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3 • Inadequate - Information about the tingle. Intervention, or design h 
very poorly described. It Is difficult to be confident ibout what 
happened In the study, replication would be Impossible without further 
InforiMtlon, and many blanks exist In categories II, III, and/or IV, 



V, OUTCOME 



Outcome Measured for: 

1 » tarqet Child: Child who Is the prime focus of the Intervention 

effort, whether medical, educational, telling change, or other type of 
Intervention. 

2 ■ Sibling of Target Child: Includes any children living In the same 

home with the target child for whom effects of the Intervention are 
measured. 

3 » Non-MbUnq Peer of Target Child: Includes any children who associate 

with the target child but do not live In the same home for whom 
Intervention effects are measured. ■ 

4 » Parents: Parents of the target child or any other adults living In 

the same home with the target child. 

•Test - Administered to: 

1 » Group: Includes any test which Is administered to more than one 

person at the same time. 

2 » Individual: Any test which Is administered to only one person at a 

time. Includes Interval observation data In which for any given 
Interval, only one person Is being observed. Interview data, physical 
ex a* data, and any other data for which the data collection only 
Involves one person at a time, 

Screening Measure: A screening measure Is a general term for any 
Instrument which Is used as a rapid selection process, usually not very 
precise, to select subjects for further testing, diagnosis, or treatment, 
(x.mples of frequently used screening measures Include the Denver 
Developmental Screening Test and the Fluharty Preschool Screening Test for 
language. 'Code N 0* If the Instrument was not developed to be used 
primarily as a screening test and *)" If the Instrument was developed to 
he used primarily as a screening test regardless of Its use In this 
pAitlcular study. For example, If the Denver Developmental Is used as a 
primary outcome measure with no Intent that It function as a screening 
device. It shou'd still be coded T on .nls Item. 

type of Measure 

fhr following listing provides examples of the types of tests which should 
be Included In each category. The EIRl Test Descrlotlon Manual contains 
brief descriptions of many of these tests as well is norm data and 
descriptions of the types of Items Included. For each test described In 
the tint test manual, the specific suhscales, If any, which should be 
computed are described. Except where so noted In the test manual, 
compute only one effect site per test. If In doubt about Otether a test 
hAS been used appropriately or the number of effect sites to compute per 
test, sec Dennis or Karl, 
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t • Verbal Intelligence Test: Include tests like the verbal portion of 

Wechsler Scales (WISC, VlSC-ft, and NPPSI), Verbal Scale on McCarthy ! 
Scales, and the verbal portion of the Cognitive Abilities Test (CAT). 

2 • Nonverbal /Performance Intelligence Test: Include performance portion 

of Wechsler Scales (WISC, WISC-I, and WPPSI), Perceptual -Performance 
Scale on McCarthy Scales, Progressive Matrices, Goodenough-Harrls 
Drawing Test, Letter International Performance Scale. Pictorial Test 
of Intelligence, and Columbia Mental Maturity Scale. 

3 'Full Scale/General Intelligence Tests A psychological test designed 

to measure cognitive functions such as reasoning, comprehension, and 

Judgment. Include Full Scale on Wechsler Scales (WlSC, WlSC-l, and f 

WPPSI), Stanford-llnet* General Cognitive Index (GCI) or the McCarthy 

Scales, Slosson Intelligence Test, the Mental Development Index (KOI ) $ 

on the Rayley Scales of Infant Development, and the Otls-Lennon Mental 

Ability Test. Notet The Quick Test and the PPVT (Peabody Picture 

Vocabulary TestTsfiould be coded #10 (Receptive Language). 

4 • Developmental Quotients Infant scales provide a basis for 

establishing the child's current status and any deviations from normal 
expectancy. Include the Gesell Development Schedule, the Cattail 

Infant Intelligence Test, tht Infant Psychological Development Scale ! 
(Plagetlan), the Griffiths, and the Al pern-loll. , 

5 • Fine Motnrt Small muscta-tfependent skills such as reaching, grasping, 

and eye-hand movement. Include Fine Motor Composite score on the 
Irulnlnks-Oseretsky Test of Motor Proficiency. 

6 • Gross Motor; Large muse It-dependent skills such as walking, running, 

and throwing. Include Gross Motor Composite Score on the Irulnlnks- i. 
Oseretsky Test of Motor Proficiency. r ' 

7 • Gross/Fine Motor Combination! Include Total lattery score on the 

Irulnlnks-Oseretsky Ttst of Motor Proficiency, the Motor Scale on the 
McCarthy Scales of Children's Abilities, and the Motor Scale on the 

layley Scales of Infant Oevtlopment. ,; 
I • Perceptual Organltatlens Include Perceptual -Motor Tests/Visual Motor ! 

Tests. Exmnples Include the lender Visual Motor Gestalt Test, 

Developmental Test of VI sua) -Motor Integration (leery ), Purdue 

Perceptual-Motor Survey, Developmental Test of Visual Perception 

(Frost lq), end the Jtavlsed Visual letentlon Test. 
9 • Expressive Language: Skills required to communicate Ideas through 

language such as writing, gesturing, and speaking. Include tests like i 

the Carrow Elicited Language Inventory, Developmental Sentence 

Analysis, and the Parsons Lanquage Sample. 

10 • Receptive Languaoes Language that Is spoken or written by others and 

received by tU individual. Includes listening, reading, and 
understanding sign language. Include tests like Assessment of 
Children's Language Comprehension, Languaoe Comprehension Test, Peabody 
Picture Vocabulary Test, Quick Test, and the Vocabulary Comprehension 

Scale. ! 

11 • Articulation: The production of speech sounds. Include tests like 

6o1dman*Fr1stoe Test of Articulation and the Tempi In-Darley Test of j 
Articulation. 'i 

12 • language Combination or Other Languages Note. Two or more of rs 9, , 

10, and II or some other language test thiTJoes not fit In II, 10, and 

11. Also Include auditory dlscrlmlnat lon/ptrcept Ion tests. Include ro 1 
tests like the Houston Test of Language Development, Northwestern ' 
Syntax Screening, Test of Language Development, Utah Test of Language "n 
Development, fttceptlve-Cxpresslve Emergent Language Scale (REEL), and Si* J 
the Sequence Inventory of Communication Development. ^ 
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13 • Sod 11 rune t Ion Inq/Adaptlve Behavior; Ability of an Individual to 

Interact appropriately and effectively with hit/her environment. In- 
clitdos tests like AAMO Adaptive Behavior Scale, Adaptive lehavlor 
Inventory for Children, Balthaiar Scales of Adaptive Behavior, 
Caln-levlne Social Competency Scale, Preschool Attainment Record, 
I.H.R. School Competency Scales, and the Vlneland Social Maturity 
Scale. 

14 * Interpersonal Interaction: Observations or ratings of the quality or 

frequency of an Individual's Interactions with others In his/her 
environment. 

15 • ITPA (Illinois Test of Psychol Inqulstlc Abilities): Psycholinguist Ic 

measure. 

16 • Preacadcmlc/Academlc: Readiness tests and achievement tests. 

Include tests like the Roehm Test of Basic Concepts, Classroom 
Reading Inventory, Key Math Diagnostic Test, Peabody Individual 
Achievement Test, Wide Range Achievement Test, Woodcock Reading 
Mastery Test, and the Metropolitan Readiness Tests. 

W • Psychological/Emotional Functioning: Includes Behavioral Checklists, 
projective tests, and personality tests. Exmnples of Behavioral 
Checklists include the Devereux Child Behavior Rating Scale, Burks 
Behavior JUilmj Scale, and the Walker Problem Behavior Checklist. 
Examples of projective tests include the Children's Apperception Test 
(CAf), Mouse-Tree-Person, and the Oraw-A-Person Test.* 

IB « Self-Concepti The person's tense of his or her own Identity, worth, 
or capabilities. Include tests like Coopersmlth's Self-Esteem 
Inventory, Plers-Harrls Children'* Self -Concept, and Llpsltt's 
Self-Concept Rating Scale for Children. 

19 - Attitude: Typically yield a total score Indicating the direction and 

Intensity of the Individual's attitude toward a person, policy, 
program, or oth< stimulus category. An example Is the Llkert-type 
scales and/or the Thurstone-type scales. 

20 • Parenting Skills: Degree to which the child's parents exhibit skills 

necessary or appropriate In developing their children 1 ! potential or 
managing their child. 
?1 « Health Status/Physical Growth: Soundness/vigor of body and mind; 
freedom from defect or disease. Measurements *f height, weight, and 
head site are examples of such measurements. If an article provides 
a large nunhet* of very specific measurements of growth and physical 
development, you should code measures of height, weight, and head 
circumference as separate effect slics. Collapse all other measures 
of physical growth and development Into one average effect she. If 
for your particular study, this does not seem to make sense, see Karl 
or Dennis. 

22 * School Progress/Placement; Percentaqe of children placed In special 

service piograms and/or percent of children retained in grade. 
2) - Other (specify) 

'Mote: The Draw»A-Pcrson Test Is sometimes scored and interpreted as a 

Developmental Scale. If scored wd Interpreted as a Developmental 
Scale, it should be coded as f< and not ft;. 



316 



ERIC 



it 



34 



5. Genirilltitlon of Skill Across Persons or Settings 

11 or Jnot*l«dg« gained In one setting or with one oartlcuWr tnin.r i. 
other settings or with other trainers. Oeneralliat Ini «il «5. , L ,n 
whether the skill or knowledge Is maintain* over 2 tle^rtli «r 
lllYtl l,n P.!5 hU h «««■ outcomes such a, ^uag5 acSll !^ " 
self-he p skills, and many academic and social functlonlnj skills ' 
General Hat Ion It not tlkiAaQg „„ < r M , t ^^s^O hit ell ar^wth 
an£schooj_p^oVmT Definitive definiti ons o f when ^fSliitLrP ' 

5KF" 1 r ? ,w " ** de »«^» «S on'tow o. Su ar 

category of outcomes Is defined and Measured, to each iltcoE «u Si I ' 

need to .eke a decision of whether general liatloT of the skllT 

Eh!' cu liW'l J!? 111 *'••*■■"» "is Intended to develop I anouaoe unit 
strange to the child to elicit the VJJ.ssIvS anluaoe Kould be rodld 

of the ntervent on on the child's parents or ilhllnm «....!/ 
parenta attitude towards handicapping wndUlons nd sEllnS ! Eowth in " 
expressive langg.,,,, trrtet ^..^or those outcoWTshou Id t code? V 
(not a concern for this outcome). General liatlonls only a concern for 

Emi tr4, !!i n »- * W u?d 0 J" n to^od. 

sr«w rs ass! - — bj-ks. w 

6. Instrument 

1 " Xlnn ft J.'n2L° r untrl,n « d or Involved professional, 

ffi °I I! d,f,ned " "V Ma,urt * ,c " solicits a person's op n Ion 
about a phenomenon or set of clrctmtstances such as their child's 
ability to speak, activity level, attitude towards school etc which 

mi c"fil 0 ^o 4 w2!rti,!^• ,,,0 ?; WhMm ' ^WtfrfS 

!?V., i t0 w ? n - d, '*"«o questions or rat ngs Instead of a oeneral 
9'P d ;I Impression. It should be coded as "J" or "i- below htL 

It St r',.n h oVfe L h0 r ,d i" »?''«"A S " f«- " 
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3 ' Interview, ratlnq or questionnaire. This Includes any written or 

verbal response to a measure havlnq 10 or more Item* Thli codlnq 
Includes standardlied rat Inn scales such as the Walker Behavior 
Checklist, the Wise Hyperactivity Rattnq Scale, the MHO Adaptive 
lehavlor Checklist. 

4 • Unstandardlted objective Pleasure. To be rated In this category, the 

mt.lorlty of the ratings must be based or. recall of past observation! 
rather than ratings done at the sane time the child ll asked to 
Perform a qlven task. 

5 • Systematic Observation. Direct real time observation using well 

defined operational definitions. This Includes ratlnns of tasks a 
child Is asked to perform such as stacklnq blocks, walking, etc. which 
are not part of a standardlied measure (e.g., Stanford-Blnet 1Q Test), 
and observations such as Interval sampling of on-task behavior from a 
classroom setting. 

A • Standardlied Objective Measure* An outcome Instrument of empirically 
elected items which has unambiguous directions for use, standardlied 
procedures for administration and scoring, adequately determined 
norms, and data on reliability and validity, included In this 
cateoory would be paper and pencil tests, IQ measures which Involve 
demonstration, Interview, and observation, and verbal response 
measures such as the PPVT. 

1 « Physical measurement. Any calibrated measure of physical or 
neurological growth, functioning, or performance such as height, 
weight, lead circumference, heart rate, EEGs, or galvanic skin 
response. 

n • Composite: Any combination of Instruments used to measure the outcome 
for which separate scores cannot be determined. In other words, the 
outcome may be an average percentile ranking of a combination of 
systematic observation and standardlied objective measures where 
separate scores for the different measures are not given. 

9 « Other: Any other Instrument used to measure outcome which does not 
fit Into one of the previous categories. Data about school progress 
or retention or placement In special clashes should be coded In this 
cateoory. 

7. Primary Data Col lector /Informant 

1 • Untrained paraprofesslonal or parent. Assume parents and 

oaraprofesslonals are untrained In collecting data unless the article 
specifically states that they have been trained. 

? • Trained paraprofesslonal or parent. Any paraprofesslonal or parent 
who has been specifically trained to collect the data on which that 
outcome Is based. Interviews with parents concerning their child's 
activity level would not be counted In this category unless the parent 
H,id been trained to systematically collect and record observations 
rturtno the week on which an Interview could then be based. 

3 * Professional hut not likely to be trained by virtue of professional 
status, for example, a classroom teacher who administers a 
Stanford-ftlnet or a WlSC who was probably not trained In the 
^ministration 0 f Individual I ted IQ test. Assume that professionals 
who *r* not typically trained to administer a particular test are not 
trained for the purposes of this study Unless specific Information Is 
nlven in the article. a ..... 

A i Professional specifically trained or likely to be trained by virtue of 
nrnfesilonal status. This should he coded when the article states 
tlMt the professional person was specifically trained or the test Is 
a tyoe of test for which professionals In that area are typically 
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ln5uS:./?« ? ll ? p, • , "f 11 PVMmtaH havt be* trained to fly. 

J Q l f? U ' u * c " rl •»•»• k ««" I"'"* U emitter 
tUnd.rd led achievement tuti, end mst ipiech theraolitt hiJa ktM 
trained to admlnliter th. ffVT or Art, on. SrtleiiStlS t«t. * 

8, Instrument Reliability: 

1 • .AO • 1,0 

2 • .19 - .60 

3 • .59 «nd below 

In at many c.m as poulblc, Initrwtnt rellebltlet for outcoMt Jmuld 

Si" 1 '!! 1 '?.* 'I "° • n '*»«t<oo U reported In he itudy WtTlfic t2 It 

data collection for that particular outcome m th Sal nraii 5 

report Information from the CI* I 'tTSSl. If* JStlm^SmU 

S! SisS «TX«« • 

9. I low #8 Vat Ettlaatedt 

* ; **E^i•!!m. Sl ^ <ly, M * e » dfd ,or toott "tudlei *1eh actually report 
a reliability for that particular outcome for that particular imU 
"L^" 1 ?' J* 0- " W «» toll cateoory "f the itudj 

%s& vuz sass ■ ruS - • 

3 • Eittmateds Reliability w.i ettlm.ted for the particular Mature b.tad 
on convention flven above. If you do not believe a rtllabliuj £ 
be ettlm.ted. ice Oennlt or Karl before olvlnt up. ew 

10. General quality of Out com Heaturti 

I^lI»i?^. fo1,ow,n, * pr °" dur " ,or e ° d,n « ^ ««"«•■•» *»«my 0 f ^ 



t tt LUrwH I tfMt 

1 " tr " ■ J ***** *» >— '* » <mr.lMd «■ twlwd rtf«nu«,i x 



. •» * ?»•'** Cll.lt t«. i, M k*r, ir.iMe r*f*HlM(l 

I. UltrvlM, r.tlM, «MHtMMtr« » 

I. WtflMfcrdlMd ..J.ciIh w*wr. * 

I. Nifk U(«r«K* .kl.r«.|lM tytt n 



SfitMitla iftitrvallM (1m ur #rf<lt t lyttM) 
9. StaaliraiiN +Ih%U9 mtiw$ 

a. f*|llUl •fllMfAHM 



s 



DltUO . tt Him" ttUtatJ In Step II fir ft1lt«!n< (harKtarlitkS. 

»1 I 0 1 J 



t tiHJtvMtfit itoUhtnttw 

• am c«llt<l«r tPtcmciH* 
Iritnttf pr iltirly prtftt* 

f tMttty milt If It* 

• rchiMHly rtpwtH pr 
from tUJfcHthttf tftttn*Mt 
Mill) .1$ #r MfMr 

a cltKly tit** KtaUlttntlP* 
«Uh ff.ttrtHitllfft Ktll 



t ft«p itolAlttnt <** 

t pMlHMcitlftM tf Itil 
ftfcUlttritor wiclftr 

• rtltumtty ttttmtf* 
Iftwttii I. DO • ,70 ar 
cU*r Ijf tiimlllMtf 
fcttwtM .14 • JO 

• pr**ty bun* iitaUH* 

tf it U n 



t Mt muttftri tt 
fctoUttttr tftttrv 



ItltNtr rtnrtftf tr 
frtt ct*viAttt*t) 
It ti IM 70 

t prt»*ly tr *H« 
ftlttty Ml MU4 
i*tfttttrittt* 

t Afcrr*» tvictat - U 
•mi tmtrt fiMctlM* 
:Hly faptrtitt 
M Ml prttttt, 
t.t.. liAfwiit mi 

h((M It Mff 
Uttlt It* 
• fcl|fc UftrtMt tr Mtr 

mfifli iiiifliijifii 



(ntqorUt lii «*0 9 r f| V f i cvc i| 9 f HcmmI Qo/llty t' Out CM ftityri" estrPlM 
to potnll llllfMtf U ctflMtlltt* ff SUM II Ml #1. 



itmS if •♦mmI QvalUy 
ST OutctM Kt ftwrt 


Paint! 


1 • M*> * 


It 




1*1 


3 


3-4 


4 


l-l 


S • 1m 


0 m Uti 



U*< 1 tffltraln^ in Sttp 13 fry! 

, . i ■ 

• OrofiptA* I Itvtl if Mica** «ii acvtltptl it i urtiiitft* miiwi mi mti as 
outcw <k «it twfrtt*itlilly Inipprtprlitt for m 9 with Mil ptrtUwl* 

pnPulltltt. 

• Oropplni | |»tll If twltt** wii unity iMPProprlilt ftr wit wltfc Uit 
papulillcft k km ki titrt«tly mrr** »4 MAfiHtctlMjl miturt 

•r tMMUtr wit t«trt«tty tf»«wtllHtt. 

II. Months After Intervention Initial Outcome Was featured: Report In whole 
months the total time elapsed since the program for thll ES group 
toMtit'nceri. Round IS days or less down to the last whole month. Round 16 
days or more up • * next * ". Example; 9 mo. 13 days • code *. 

\?. Months After Intervention Complete d Outcome Was Measured: Report In whole 
months the total time elapsed since the program for this ES qroup 
comnrnced. Round day* same as aoove. Example: 0«os. 7 days • code 0. 
If the program was still In operation at time of outcome measure, code 0. 



VI, CONCLUSIONS 

1. Standard I jed Mean Difference If feet Slit 

Standardlied mean difference effect iltet can be computed In a number of 
different ways. The order of preference for calculating an effect tlxe It 
olven In Item 2 below (Oata from Which Mean Difference Effect Site Vat 
Calculated) • for preferences 1, 2, and 3 4 there are a number of 
alternative ways to obtain the meant and standard deviation! used. The 
matrix below Indicates the way to determine which Information to use. 
First, 90 down the rows from raw gain to final status Measure. Nek the 
Information In the article which hat the lowest number associated with It. 
Then move from left to right In that row across the columns and pick the 
standard deviation measure which you come to first. 



Source of Mean 
Difference Estimate 


a. 

no treatment 
SO 


b. 
pooled 
SO 


*c. 

t.tt mmuii 

so 


1. Raw qaln 








2. cover tance 
adjusted 








3. Residual oaln 








4. final status 









In addition. It will sometimes be necessary to compute an effect site for 
when one experimental treatment has been compared to another experimental 
treatment. In such Instances, you must determine which treatment to use as 
the "experimental" group and which treatment to use as the "control" group. 
In making the computations for mean of the "experimental" group «1nus mean 
of the "control" oroup divide by the standard deviation of the "control" 
group. In those Instances, select the most Intensive treatment as tte 
"experimental" group and the least Inttnslve as the "control" group. In 
cases where there It not a most Intensive treatment (e.g., home-bated 
vertus center-bated for the tame amount of time or piraprofettlonalt versus 
professional!), select the most frequently used option as the 
"experimental" group. If there are questions about which option would be 

the most frequently selected, talk with Karl. 

< . 

In calculating effect sites when ff 1 * and SO't are not given, the estimates 
of correlations between tests mu:t sometimes be made. The following 
conventions have been adopted for some of the most frequently required 
estimates (all of these represent Immediate test-retest. Tests separated 
substantially further In time would be slightly lower,) 
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Achievement 


IQ's 


10*1 


IQ's 






Good 


Avenge 


Poor 




.60 


.an 


.65 - .70 


.45 


Avoi 


.50 


.65 - .70 


.60*1 


.40 


Poor 


.40 


.45 


.40 


.30 


hlfvnnont 


.60 


.60 


.50 


.40 


a\A Ivn Behav lor 


.30 


.40 to .SO 







Adaptive to Adaptive .to 
Visual-Perceptual to Visual-Perceptual .80 
Visual-Perceptual to Achievement .45 



?. n*ta from which Mean Difference ES Was Calculated 

I » Means and control group SD • Article oave means for the experimental 

and control groups and i standard deviation for the control group from 
which ES was calculated. 
? « Means and pooled SO - Article gave means for the experimental and 
control groups and a pooled standard deviation from which the ES was 
calculated. 

3 • Means and published test SO • Article gave means for the experimental 

and controV groups and the standard deviation was known for the 
published test used as an outcome measure. ES was calculated from 
these data. 

4 • t rat1o/F ratio from one-way ANOVA - Article gave a t or F value for 

one way A NOVA from which ES was calculated* 

5 « t ratio from matched pairs, t test, or F ratio from mixed model A NOVA 

6 » Source of variance table iroS n-way A NOVA 

7 - Source of variance table from n-way ANCOVA or mixed model ANOVA 
ft - ANCOVA F ratio. 

Q > Nan-parametric test statistic except chl squared. 
10 » Probability estimate for I test or one-way ANOVA. 

II « Roqresslon lines. ~ 

1? ■ Proportions ("problt" transformation). 

13 « Chl square table. 

14 * Other , . 

specify) 

J. Scalq of Mean Difference for ES 

1 * Raw qaln score: Code If the way In which means between experimental 
and control were calculated was the difference between the pretest 
scores and the post test scores for each qroup, In other words 
(experimental post • experimental pre) - control post - control pre). 



2 ■ Covarlance adjusted scores: Differences between experimental and 

control group were computed using scores which had been adjusted for 
differences on some other concomitant variable using analysis of 
covarlance procedures* 

3 - Residual gain score; Code when posttest scores on the measure were 

predicted using subjects 1 pretest scores and the outcome measure was 
based on the difference between the subjects 1 predicted score and 
his/her obtained score* 4 t , . h t 

4 - Final status measures; Differences between experimental and control 

group were computed using an unadjusted posttest score for the two 
groups. 

4. Variance Effect Site 

This Is a measure of the degree to which the treatment may have Impacted on 
the distribution of the population rather than the mean level of 
performance. It Is obtained by dividing the standard deviation of the 
experimental group by the standard deviation of the control group. 

5. Author's Conclusions 

0 - not considered - author(s) make no statement regarding clinical 

significance of treatment* 

1 ■ Intervention appears to work - author(s) conclude that treatment 

works* Those cases where the author concludes that the Interven- 
tion works but only for certain subsets will usually be accounted 
for by the different ES categories* if this does not account for 
It, code It "1* anyway* 

2 - data equivocal about intervention effectiveness 

3 - intervention appears not to work 
I 6* Country of StudV 

7* Profession of Research Designer 
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COMPUTATION Of STANDARDIZED MEAN DIFFERENCE 
EFFECT SIZES* 



DIRECT CALCULATION 



General Guidelines : In all cases, we need an estimate of where the average 
subject In the "experiment al" group would score with respect to a 
distribution of comparable Subjects who did not receive the treatment. 
Therefore t in all cases, we need an estimate of the average differences 
between groups which has been standardized (or divided by) the standard 
deviation of the distribution of comparable subjects. When 'direct 
calculation Is not possible, use the following guidelines. Examples for the 
most common applications follow. 

Mean Differences : We need the best estimate of the average difference 
between "experimental 11 and "control" group scores. When Subjects are 
randomly assigned to groups, we assume they are equal In the beginning, so 
7f - Yc yields an accurate estimate of average differences between 
groups. However, to the degree that there are random differences between 
the groups In the beginning, Y|r - will also be biased. Using 
(Yc - T[) - (Ye - improves the estimate somewhat, as would 
covarlance adjusted scores. Although neither are perfect, both are better 
than using only final status scores. When groups are not randomly assigned, 
anything we can do that will adjust the final status scores so they are more 
nearly like scores of groups which are comparable In the beginning Is 
helpful (e.g.. gain scores, covarlance adjustments, residual Ixed qaln 
scores). The general rule Is to obtain the best estimate possible of what 
the average difference would have been If the groups had been comparable In 
the beginning. 

Standard Deviation : The standard deviation of the "control" group 1s used 
to standardize the average mean difference between groups because that Is 
the best estimate of variance In the distribution of untreated persons. 
NeveFuse a standard deviation which has been artificially reduced (e.g.. 
through analysis of covarlance. or stratification In analysis of variance) 
or which estimates some other distribution's variance Instead of the 
variance in a distribution of untreated persons (e.g.. standard deviation of 
mean differences, standard deviation of gain scores, etc.). 



^Throughout this summary, the following notations appjy: £ (as used In 
*E. n£, Sf) refers to the "experimental" group; C (as In Xc, nr, Sc) 
refers to the "control" group; nr. or nc refers to the number of subjects In 
the "experimental" and "control" groups respectively; H refers to the total 
number of subjects in the desiqn; n p refrs to the number of pbirs of Subjects; 
r^y refers to the correlation between two variables (e.g.. pre-post test, 
eovariate and dependent variable, matching variable and dependent variable). X 
refers to the pretest mean; Y refers to the potttest mean. 
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t_ Teat Designs 




Effect Sl2e Computation 


Standard Deviation Used 


from Significance Test 


in RS Computation 


a) given t value 




a) given S 








S • 

1 


//vv 



ASSUMES: 



• S c s S c 



n^ehed-feirg t Test I 



Effect Size Computation 
from Significance Test 

a) given matched pairs t test <t d ) 
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as shown below. 
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.68 
.48 



,628. 
141 
70 
318 
99 

10 



AC 



BEST COpv MIUBIE 



.41 
.36 
.44 
.38 



.37 



. . .41 . 
.42 
.39 



.41 
.42 
.42 
.42 
.31 



.41 
.41 
.44 
.35 
.57 



341 



..58. 
.54 
.56 

1.06 



.58 



• • t60 t t 
.59 
.63 



..59. 
.61 
.57 
.54 
.60 



.59. ^ 
.65 p 
.46 ot 
.55 
.66 



VARIABLE NAME 



II I -4c AI0E1 



DESCRIPTION/CODES 



Involvement In Intervention of aide 

0 « not at all 

1 » minor 

2 » major 

3 a only Intervenor 
MISSING DATA 



I of data 
points 
(N) 



123 
75 
40 
6 
2 

16 



HANDICAPPED 



re 



.56 
.51 
.68 
.46 
.47 



SD 



.64. 

.66 

.61 

.71 

.06 



I of data 

points 
(N) 



,589. 
251 
293 
38 
7 

49 



SAD V ANT AGED 



.40 
.50 
.28 
.69 
.71 



III-4d SUPPORT 1 



1 1 Me MEDICALl 



Involvement In Intervention of support service personnel 

0 - not at all 

1 ■ minor 

2 ■ major 

3 ■ only Intervenor 
MISSING DATA 



116 
61 
39 
8 
8 

23 



.54 
.45 
.66 
.64 
.54 



,.65. 
.68 
.67 
.27 
.62 



.549. 
446 
101 

2 



89 



Involvement In Intervention of medical personnel 

0 ■ not at all 

1 ■ minor 

2 ■ major 

3 ■ only Intervenor 
MISSING DATA 



99 
18 
1 
1 

20 



, .53 
.56 
.34 

1.74 
.53 



,.65. 
.65 
.57 
.00 
.00 



.557. 
506 
43 
8 



81 



, .40 
.39 
.47 

• 1.68 



.39 
.38 
.54 
.34 



II 1-5 ITRNING1 



1 1 1 -6a HRSDUR1 



34 



2- 



Training of primary Intervenor 

1 > certified with 24+ hours program specific training 
certified with no program specific training 
not certified with 24+ hours program specific training 



2 
3 

4 > not certified with no program specific training 
MISSING DATA 



92 
17 
10 
37 
28 

47 



.56 
.76 
.80 
.52 
.40 



..64. 
.41 
.56 
.78 
.54 



.543. 
258 

41 
200 

44 

95 



Hours of Intervention per week 



1 

2 
3 
4 

5 
6 
7 
8 



<.5 hrs/week 
.6 - 1.0 
1.1 - 2.0 



2.1 - 
5.1 • 
10.1 



5.0 
10.0 
20.0 



20.1 - 30. 0 
30.1+ 



MISSING DATA 



43 
9 

10 
7 
9 
2 
2 
4 



96 



.67 . . 




.74 


.87 


.33 


.19 


.57 


.59 


.84 


.61 


1.14 


.78 


.63 


.13 


.97 


.05 



.358. 
24 
43 
85 
55 
38 
69 
4 

40 

280 



.36 
.46 
.30 
.24 
.42 









.54 


.35 




.55 


.42 




.69 


.66 




.69 


.54 




.17 


.33 




.56 


.57 




.42 


.30 


• 


.37 


.46 



ERIC 



BEST COPY AVAILABLE 









HANDICAPPED 




01 


S ADVANTAGED 






1 of data 


re 




1 of data 






• 




points 


SD 


points 




SD 


VARIABLE NAME 


DESCRIPTION/CODES 


(N) 






(N) 






IJi-DD N&dUUnl 




1 tc 




74 


C 1 C 








1-0-5 weeks 


26 


.67 


.63 


6 


.56 


.50 




9 u A - 10 








1 7 


.81 


59 




3-11-24 


16 


.52 


.49 


52 


.62 


• 56 




4-25-52 


39 


.66 


.62 


327 


.38 


.58 




5-53-78 


3 


.36 


.26 


61 


• 63 


40 




6 - 79 - 104 


6 


.86 


.75 


59 


.36 

• JO 


• JO 




7 « 105+ 


36 


.27 


.91 


94 


. .40 


S3 




MISSING DATA 


13 






22 






II1-6C T0THRS1 


Total hours of Intervention 


t t »38 • 


• • • 76 • • 


t tt 56 1 § 


• . 343 • . 


. . . 54 • 


• • »55« « 




1 ■ fl m 20 hnitrc 
i u 4u iiuuf a 


10 




AQ 


1 


.46 


22 




2-21-50 


4 


.44 


.26 


23 


72 


79 

• » ^ 




3 - 51 - 100 


8 


.99 


.69 


5 


96 


lfi 




4 - 101 - 500 


7 


.36 


.19 


115 


• 48 


51 




5 - 501 - 1000 


7 


.69 


.36 


119 


» *J? 


AO 

tDU 




6 - 1001+ 


2 


.63 


.10 


74 


40 


•to 




MISSING DATA 


101 






295 






11 1-7 M00E1 






... 53 . • 


. ..70. . 


. .634. < 


. . .42 . 


• •*59« • 




1 ■ cQUCdLiOnal 


AA 
DO 


• DC 


en 
. ou 


33/ 


32 


S7 




2 ■ medical 


22 


.38 


.51 










3 ■ setting conparlson 


0 


.34 


1.31 


12 


.15 


1.08 




4 ■ stimulation 


10 


.48 


.84 


4 


1.09 


1.09 




5 ■ diet 


10 4 


.38 


.36 










6 ■ other 


19 


.63 


.72 


61 


• 41 


• 56 




IJI CC IMP flrtTA 

HISSING DATA 








4 






I II -8a CURRCLMl 


Was a specific curriculum used for Intervention? 


« • • 76 • 


• • • 68 4 $ 


* ••63* • 


. .524. . 


« • • 39 • 


• • • 58# • 




0 « no 


55 


.59 


.56 


266 


.37 


.52 




1 « yes 


21 


.92 


.71 


258 


.41 


.64 




MISSING DATA 


63 






114 







ro 
i 

CD 

oo 



ERIC 



344 



345 



BEST COPY AVAILABLE 



3<i 

ERIC i 



VARIABLE NAME 


DESCRIPTION/CODES 




HANDICAPPED 




D 


SADVANTAGE 




1 of data 
points 
(N) 


R 


SD 


I of data 
points 
(N) 


re 


SD 


1 1 1 -Ob STRCTRl 


Degree of structure in instructional curriculum 

1 ■ very structured 

2 ■ somewhat 

3 ■ not structured 

4 » no Instructional curriculum used 
MISSING DATA 


8 

48 
6 

73 


.12 
.76 
.67 


.60 
.67 

.59 


95 
365 
75 

103 


.50 
.39 
.29 


.62 
.57 
.49 


1 1 1 -8c CNTRL1 


1 ° mostly child controlled 

2 ■ mostly intervenor controlled 

MISSING DATA 


7 
63 

69 


.83 
.59 


.46 
.67 


75 
506 

57 


.10 
.46 


.31 
.58 


1 1 1 -8d F0CUS1 


1 ■ language 

2 ■ self-help 

3 » motor 

4 » social-emotional 

5 ■ behavioral 

6 ■ cognitive 

7 ■ combination 

8 ■ other 

MISSJNG DATA 


9 

4 

7 

1 
57 

61 


.76 

l"l2 
1.13 

.06 
.50 


.54 

"89 
.72 

.00 
.59 


36 
5 
6 

27 

90 
445 

29 


.58 
.18 
-.57 
.26 

. .55 
.39 


.36 
.35 
.41 
.34 

.67 
.55 


II 1-9 THERTCL1 


0 ■ no 

1 ■ yes 

2 - comparison made that is not clear in III 
HISSING DATA 


90 
19 
30 


. . .53 . . 
.54 
.75 
.35 


. ..70. . 
.63 
.68 
.86 


381 
137 
105 

15 


. . .41 . 
.44 
.52 
.12 


. . 59. 
.52 
.70 
.57 


1 11-10 PRNTCHD1 


To whom was treatment delivered? 

1 ■ parent only 

2 » child only 

3 ■ parent and child together 

4 = parent and child separately 

5 ■ both parent and child but not clearly (3) or (4) 

MISSING DATA 


8 
77 
13 
10 
23 

8 


.25 
.58 
.64 
.35 
.47 


.44 

.77 
.46 
.27 
.76 


21 
377 
126 
16 
85 

13 


.78 
.41 
.34 
.67 
.40 


.89 
.60 
.51 
.32 
.58 

V 


II I -11 TOTMPRl 


1 a 0 - 5 hours 

2 = 6 - 10 

3- 11-25 

4- 26-50 

5 « 51 - 125 

6 - .126* 

MISSING DATA 


1 
6 
6 
2 

5 

118 


.54 
.38 
.30 
.57 

.09 


.37 
.42 
.10 
.56 

.41 


18 
14 
40 
48 
54 

464 


■ « « 35 • 

• 62 
fid 

.04 
.38 
.43 


CI 

• • # 56* ♦ * 
.65 



VARIABLE NAME 






HANDICAPPED 




D 


^ADVANTAGED 


DESCRIPTION/COOES 


1 of data 
points 
(N) 


ft 


so 


I of data 
points 
(N) 




SO 


III-12a VSTSM01 


Average I of visits/month to parents to supervise/assist. . . 

1 « 0 - .5 visits/month 

2 • .6 - 1.0 

3 - 1.1 - 2.0 

4 » 2.1 - 4.0 

5 a 4.1 - 10,0 

6 « 10.1+ 

MISSING DATA 


10 

7 
1 
6 

2 

113 


.42 

"l8 
.06 
.51 
.36 


.46 

.38 
.00 
.38 
.21 


67 
7 

36 
18 
95 
2 

413 


.45 
.49 
.36 
.38 
.24 
.41 


.59 
.17 
.61 
.58 
.56 
.24 


1 1 1 -12b PARTRHRl 


Average I of visits/month to parents to supervise/assist. . . 

1 - <1.0 

2 ■ 1.1 - 4.0 

3 - 4.H 


127 
3 
9 


. . . S3 . . 
.55 
.52 
.21 


. ..70. . 
.72 
.40 
.33 


• .638. • 
528 
99 
11 


. . .42 . 
.44 
.32 
.33 


• • . 59. * 
.59 
.55 
.47 


III-12C TYPEHOM1 


1 » training family member as Interventionist 

2 « tutoring In home by non-family 

3 ■ material/toy lending 

4 ■ health/social services 

5 » combination 

MISSING DATA 


41 
1 

4 

4 

89 


.37 
.06 

m 

.44 
.47 


. ..51. . 
.55 
.00 

.26 
.26 


161 
7 
1 

11 

53 

405 


.33 
.70 
.08 
" .43 
.35 


.56 
.40 
.00 
.56 
.61 


III-l2d WR1TEPL1 


Were parents given written plan of weekly activities? .... 

0 » no 

1 » yes 

MISSING DATA 


... 37 . 
13 
24 

102 


. . .44. . 
.48 
.42 


. . . 58. . 
.42 
.66 


. .188. . 
98 
90 

450 


. . .30 . 
.17 
.44 


. ..58. • 
.61 
.51 


III-13a RATIOl 


1 ■ 1.0 # of chlldren/l of Intervenors 

2 » 1.1 - 4.0 

3 » 4.1 - 5.0 

4 - 5.1 - 8.0 

5 - 8.1 - 14.9 

6 ■ 15.0 - 20.0 
1 * 20.1 - 50.0 
8 » 50.1+ 

MISSING DATA 


28 
13 
1 
1 
1 

• 
•a 

7 
1 

87 


... 74 . . 
.80 
.71 
.53 
.72 
.16 

.72 
.52 


. ..70. . 
.73 
.86 
.00 
.00 
.00 

.38 
.00 


. . 337 . . 
35 
62 
129 
47 
59 
5 

301 


. .1.32 . 
.61 
.33 
.30 
.26 
.27 
-.08 


. . .C^ . . 
.60 
.57 
.67 
.57 
.39 
.79 

ro 
i 

CD 

• 


lil-l3b SEGREGl 


1 ■ 1 to 1 Intervention or with same type and severity 
£ ■ larget cm io with other type and severity 
3 ■ Integrated with non-handicapped 

MISSING DATA 


86 
6 
5 

42 


... 59 . « 
.55 
1. 14 
.70 

i 


. . . 77 . . 
.78 
.75 
.32 


. .519. . 
498 

2 

19 
119 


. . .43 . 
.44 
.86 
.34 


. ..59. . ° 
.59 
.69 
.46 



y& 348 < *rmmm 3 *1 



VARIABLE NAME 



II 1-14 VERIFY1 



111-17 INVOLVEl 



1 1 1-18 COMMIT1 



1 11-19 FUNDS 



1 1 1 -20 C0NTINU1 



IV-1 DESIGN 



50 



DESCRIPTION/CODES 



Degree to which treatment was Implemented as planned 

1 a complete Implementation 

2 ■ most of treatment Implemented 

3 ■ only some of treatment Implemented 

MISSING DATA 



Degree of Intended parent/family Involvement, 

1 ■ extensive 

2 ■ moderate 

3 * some 

4 ■ none 

MISSING DATA 



Parents' commitment/cooperation for program 

1 ■ very positive 

2 ■ positive 

3 ■ ambivalent/negative 

MISSING DATA 



Funding for program 

1 ■ external funding for substantial portion 

2 ■ no or Insignificant external funding 

3 ■ probably no external funding 

MISSING DATA 



Continued Intervention program after preschool , 

0 » No 

1 ■ Yes, definitely 
MISSING DATA 



Type of experimental design used 



1 ■ random assignment 

2 ■ non-random but good matching 

3 ■ convenience and/or poor matching 

4 ■ pre/post unadjusted 

5 ■ pre/post adjusted 

7 » crossover 

8 « other 



I of data 
points 

(N) 



12T 



38 
75 
14 

12 



128 



63 
12 
15 
38 

11 



71 
10 
52 
9 

68 



137 
82 
4 

51. 



.35 



32 
3 

104 



139 
28 
12 
23 
39 
30 
7 



HANDICAPPED 



753 



.46 
.61 
.28 



.56 



.49 

.2g 

.32 
.84 



.43 
.63 
.43 
.19 



.52 
.42 
.27 
.69 



.55 
.53 
.69 



.53 
.51 
.50 
.45 
.59 
.50 
.75 



SO 



77T 



.85 
.68 
.31 



.62 



.62 
.47 
.32 
.66 



.61. 



.48 
.66 
.32 



..69. 
.66 
.18 
.73 



,.61. 
.61 
.73 



..70. 
.58 
.64 

1.06 
.71 
.42 
.69 



f of data 
points 
(N) 



634 



150 
478 
6 



610 



216 
64 
SO 

280 

28 



.288. 



64 
190 
34 

350 



.626. 
578 
11 
37 

12 



.304. 
129 
175 



334 



.638. 
326 

81 
106 

20 
103 



SADVANTAGEQ 



.41 



.37 
.44 
-.57 



.41 



.38 
.31 
.56 
.42 



.37 



.32 
.38 
.38 



.41 
.39 
.95 
.66 



.25 
.38 
.16 



.42 
.32 
.67 
.25 
.69 
.63 

.62 



SD 



759 



.52 
.60 
.41 



.59 



.54 
.55 
.60 
.62 



.55. 



.46 
.58 
.50 



..59. 
.56 
.71 
.86 



..52. 
.50 
.51 



. .59. 
.50 
.63 
.63 
.91 
.55 



•°" 6 #5 



9 

ERIC 



BEST COW AIMIUBU 



VARIABLE NAME 



DESCRIPTION/CODES 



I of data 
points 
(N) 



HANDICAPPED 



SD 



I of data 
points 
(N) 



SAD V ANT AGED 



SD 



IV-2 BLIND1 



IV-5 VALIDIDX 



V-l DVCHOPAR 



V-4 TYPEMEAS 



ERIC 



352 



Blinding of data collector 

1 B yes, definitely 

2 » yes, probably 

3 3 probably not 

4 ■ definitely not 



Overall Index of study's Internal validity 



excellent 
good 
fair 
poor 
bad 



Outcome measured for: 

1 a target child 

2 ■ sibling of target child 

3 ■ non-sibling peer of target child 

4 ■ parent 



Construct measured by outcome variable 



1 
2 
3 
4 
S 
6 
7 
8 
9 

10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 



iq verbal 
IQ performance 
IQ full scale 
developmental quotient 
fine motor 
gross motor 
motor combined 
perceptual organization 
expressive language 
receptive language 
articulation 

combined or other language (not 9-11) 
social functioning/adaptive behavior 
Interpersonal Interaction 
ITPA 

preacademlc or academic 
psychological/emotional functioning 
self-concept 
attitude 

parenting skills 

health status/physical growth 

school progress/placement 

other 



MISSING DATA 



139 
37 
16 
62 
24 



.53 
.50 
.72 
.53 
.45 



70. 



.638. 



.66 
.38 
.79 
.64 



183 
68 

318 
69 



139 
8 
15 
28 
37 
51 



.53 
.55 
.31 
.47 
.45 
.68 



..70. 
.49 
.69 
.55 
.92 
.59 



.638. 

64 
121 
226 

95 
132 



139 
130 
4 



.53 
.54 
.66 

"l5 



.70. 



.71 
.35 

.23 



.638. 
602 



36 



137 
1 



, .53 
•1.13 



.70. 
.00 



21 
25 

7 

14 

3 
1 
3 

10 
18 
7 
2 
3 
2 

1 
1 
10 
5 
3 



.73 
.65 

.60 
.35 
.49 
.97 
.82 

.67 
.22 
1.10 
.93 

.48 
.21 

.39 
.21 
.23 
.74 
.14 



.70 
.76 

.48 
.54 
.31 
.00 
.95 

.35 
.97 
.73 
.91 
.44 
.09 

.00 
.00 
.40 
.42 
.33 



.638. 
5 
6 

257 
23 

3 
24 
12 

1 

74 

• 

7 
4 

7 
42 
98 
6 
9 
7 
20 
7 

10 
16 



BEST COPY AVAILABLE 



.42 



.45 
.19 
.41 
.56 



.42 
.35 
.43 
.43 
.20 
.57 



.42 
.41 



.50 



.42 
.50 
.76 
.43 
.45 



1.06 
.30 
.72 
.77 
.50 

*41 
.39 
.58 
.65 
.21 
.32 
.13 
.32 
.48 
-.11 
.44 
.47 



.59. 



.60 
.44 
.62 
.44 



..59. 
.57 
.41 
.59 
.76 
.53 



.59. 
.60 



.34 



.59 
.42 
.29 
.59 
.67 



1.65 
.60 
.51 
.00 
.47 

"72 
.21 
.35 
.68 
.56 



.26 I 
.65 
.34 
.33 
.11 
.41 
.77 



353 



VARIABLE NAME 



V-S GENRLZTN 



I1C 



DESCRIPTION/CODES 



' I of data 
points 

m 



Generalization of skill across persons or settings 

1 ■ not a concern for this outcome 

2 ■ a concern, assessed well 

3 » a concern, assessed somewhat 

4 ■ a concern, not assessed at all 



139 
65 

22 
52 



HANDICAPPED 



.53 
.51 



.55 
.55 



SD 



.70. 
.65 



.55 
.81 



f of data 
points 
(N) 



.638. 



476 

5 

37 
120 



SADVANTAGEO 



.42 



.40 
.30 
.69 
.40 



SD 



.59. 



.58 
.14 
.78 
.52 



V-6 TYPEINST 



Instrument 

1 ■ Opinion by parent or untrained person or Involved 

professional 

2 * Opinion by clinician, teacher, or trained 

professional (unlnvoi.-ed) 

3 ■ Interview, rating, or questionnaire 

4 " Unstandardlzed objective measure 

5 ■ Systematic observation 

6 ■ Standardized objective measure 

7 ■ Physical measurement 

8 ■ Combination 

9 ■ Other, specify 

MISSING DATA 



135 
14 



4 
14 

21 
73 
9 



.52 
.39 



.70. 
.61 



.47 
.78 
.73 
.48 
.19 



.19 
.60 
.63 
.78 
.41 



637. . 
2 

8 

30 
13 
21 
553 

6 

4 



1 



.42 . 
.69 

.33 

.50 
.16 
.44 
.42 
-.14 
.39 



..59. 
.01 

.35 

.43 
.35 
.87 
.59 
.07 
.21 



V-7 COLLECTR 



V-10 QLTYDV 



V-ll M0SINT1 



35': 



0 

ERIC 



Primary data collector/Informant 

1 ■ Untrained paraprofesslonal or parent 

2 ■ Trained paraprofesslonal or parent 

3 ■» Professional but not likely to be trained by virtue 

of professional status 

4 ■ Professional specifically trained or likely to be 

trained by virtue of professional status 

MISSING DATA 



95 . 
14 

6 

5 

70 
4" 



.35 
.64 
.33 

.55 



. .73 . 
.45 
.32 
.26 

.81 



« .383. • 

36 
27 

320 
255 



General quality of outcome measure 

1 ■ excellent 

2 - good 

3 - fair 

4 ■ poor 

5 ■ bad 



139 . 
57 
62 
20 

4 

6 



.53 . 

.54 

.53 

.50 

.74 

.44 



Months after Intervention was Initiated outcome was measured 



1 

2 
3 
4 
5 
6 
7 
8 



0 
4 - 

7 - 
13 ■ 
25 • 
37 ■ 
49 • 
73+ 



3 months 

6 

12 

24 

36 
• 48 

72 



MISSING DATA 



128 
30 
19 
34 
12 
11 
14 
6 
2 

11 



. .53 
.67 
.59 
.38 
.31 
.42 
.57 

1.15 
.34 



..70. 
.82 
.64 
.51 
.66 
.66 



• .638, , 
292 
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82 


61 


73 


76 


006355 


6/01/83 


00 




96 


70 










9) 


060074 


5/18/8) 




86 




67 






90 


107 


92 


UOS322 


5/03/03 


38 


72 




78 


68 


81 


07 


77 




72 


040130 


5/09/8) 


38 


51 


36 


37 


55 


77 


73 


82 


40 


00690) 


5/31/0) 


92 








101 


121 


121 


11) 


100 


070252 


3/22/83 


49 


80 




91 








102 


91 


006973 


6/01/8) 




55 






47 






82 


62 


040161 


5/20/8) 




89 


64 


27 










64 


01)7072 


6/01/8) 






89 


49 


61 






120 


84 


060098 


5/18/8) 


06 


90 




• 95 








73 


9!> 


006625 


5/23/03 


65 


57 




89 


105 


79 


90 


98 


78 


040177 


5/10/8) 


82 


79 


61 


71 


100 


80 


111 




70 


005 700 


5/31/83 


72 




85 


70 


74 


67 


90 




8) 


021595 


5/25/8) 






83 


67 


06 








69 


00S022 


5/31/83 


)7 






)) 


)7 


12 


56 


70 


50 


07016) 


3/22/03 


81 






86 


92 








92 


003708 


5/31/83 


63 






77 


91 


82 


74 




76 


070080 


3/22/83 


72 






76 


07 








82 



CO 

I 

CO 
t 

CO 
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Individual Child Costs for Several Summary Variables 
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MENTALLY DISORDERED 



HALF DAY 



IDI 


DI HOURS 


$P£R- 
SONNEL 


$ NON- 
PERSONNEL 


$ BUDGET 


$ CON- 
TRIBUTED 


ST0TAL 

> 


IDI 


DI HOURS 


> $ PER- 
SONNEL 


$ NON- 
PERSONNEL 




TRIBUTEG 


1IUIAL 

1 


030094 


393 


4542 


1034 


5576 


1023 


6599 


005794 


160 


4877 


1104 


5981 


157 


638 


060093 


347 


6583 


2290 


8873 


1202 


10075 


006650 


182 


4575 


1160 


5735 


125 


5060 


021978 


331 


670 


1535 


8235 


347 


8582 


004286 


183 


4675 


1160 


5835 


318 


6153 


060097 


332 


7031 


2146 


9177 


793 


9970 


006226 


150 


4379 


1160 


5539 


413 


5952 


030107 


288 


3831 


1023 


4854 


1329 


6183 


005413 


272 


7352 


1309 


8741 


635 


9376 


021847 


314 


6984 


1477 


8461 


329 


8790 


006465 


182 


4711 


1160 


5871 


557 


6428 


060074 


363 


7503 


891 


8394 


223 


8617 


006355 


169 


4842 


1160 


6002 


6 


6008 


040130 


245 


9181 


1541 


10722 


1014 


11736 


005322 


150 


5146 


1104 


6250 


356 


6606 


070252 


200 


6062 


1095 


7157 


1197 


8354 


006903 


189 


486G 


1160 


6020 


1205 


7225 ' 


040161 


365 


6971 


2434 


9405 


513 


9918 


006973 


171 


5055 


1045 


6100 


1060 


7160 


060098 


376 


6430 


' 891 


7321 


223 


7544 


007072 


241 


5510 


1160 


6670 


6 


6676 


040177 


274 


5636 


1771 


7407 


135 


7542 


006625 


239 


5857 


1389 


7246 


433 


7679 


021595 


504 


7012 


1511 


8523 


1262 


9785 


005700 


117 


4435 


1104 


5539 


240 


5779 


070163 


278 


7925 


957 


8882 


684 


9566 


005022 


250 


6795 


1160 


7955 


6 


7961 


070080 


228 


6435 


1095 


7530 


1454 


8984 


003788 


130 


5054 


1104 


6158 


123 


6281 


X 


185.67 


5208.20 


1167.93 


6376.13 


376.00 


6752.13 


X 


322.53 


6588.40 


1446.07 


8034.47 


* 

781.87 


8816.33 


SD 


45.55 


856.06 


96.25 


92n nn 


Jo 3 . £j 


OQ/ /.Oil 

986 .42 


SD 


75.84 


1283.38 


518.00 


1476.11 


459.95 


1453.68 


TOTALS 


2785.00 


78123.00 


17519.00 


95642.00 


5640.00 


101282.00 


TOTALS 


4838.00 


98826.00 


21691.00 


1205.17.00 


11728.00 


132245.00 
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INDIVIDUAL CHILD DATA 
COWUNICATIVE DISORDERED 



HALF DAY 



FULL DAY 



0060075 



060106 



040151 



DI HOURS 



365 



449 



292 



$ PER- 
SONNEL 



6971 



7325 



6000 



$NON- 
PERSONNEL 



2B35 



891 



1771 



$ BUDGET 



9B06 



B216 



7771 



$CON- 
TRIBUTED 



1202 



103 



135 



STOfAL ID# 



11008 



005652 



9719 



006776 



7906 



006716 



DI HOURS 



111 



ie2 

194 



$ PER- 
SONNEL 



4796 



6497 



6696 



$ NON- 
PERSONNEL 



989 



1640 



1639 



$RUDGET 



5785 



8137 



8335 



$CON- 
TRIBUTED 



632 



227 



227 



$ TOTAL 



6417 



8364 



8562 



021835 



030095 



040170 



050073 



378 



354 



284 



6128 



1189 



7317 



1259 



8576 



006049 



230 



7193 



1639 



8832 



4378 



955 



5333 



711 



6044 



007067 



217 



6544 



1639 



8183 



5890 



1771 



7661 



135 



7796 



006871 



221 



5207 



1160 



6367 



10 



444 



521 



8842 



8627 



6888 



070263 



0'/ till 2 



040135 



030104 



SD 



Totals 



379 



232 



405 



Ijl 



347 



5839 



1218 



7057 



772? 



14779 



007035 



269 



6578 



1389 



7967 



6509 1095 



6681 



5454 



4378 



203.73 



6158.73 



43.88 



729.90 



2241.00 



67746.00 



7604 



428 



8032 



006965 



254 



5989 



1389 



7378 



1258 



7939 



1260 



9199 



004834 



176 



6180 



1104 



7284 



1541 



6995 



1597 



8592 



0C5854 



174 



5438 



1104 



965 



5343 



339 



5682 



006219 



205 



6628 



1639 



1393.73 



7552.45 



380.27 



262.23 



965.61 



192.97 



7932.73 I X 333.27 
839. 95 | I SD ' 



15331.00 



83077.00 



4183.00 



87260.00 Totals 



70.63 



3666.00 



5959.36 



1408.09 



949.60 



564.87 



65553.00 



15489.00 



6542 



267 



221 



631 



472 



356 



442 



7367.45 



8188 



8009 



7756 



6898 



8709 



1481.00 



8848.45 



1255.92 



2139.38 



2478.10 



01042.00 



16291.00 



97333.00 
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Variable Description and Data Sources 
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3-D.2 



IOWA DATA 
VARIABLE DESCRIPTION 
AND DATA 'SOURCES 



CODE 
VARIABLE 



VARIABLE 



EXPLANATION OF DATA AND METHOD OF 
DATA COLLECTION 



SOURCE 



1) ID 

2) DOBM 

3) DOBD 

4) DOBY 

5) SEX 

6) HANDI 



IDENTIFICATION 
NUMBER 



DATE OF BIRTH 
MONTH 

DATE OF BIRTH 
DAY 

DATE OF BIRTH 
YEAR 

GENDER OF CHILD 



HANDICAP OF CHILP 



7) MOHOM 



MONTHS IN HOME- 
BASED PROGRAM 



8) MOCEN 



MONTHS IN CENTE'R. 
BASED PROGRAM 



A four- or five-digit number, assigned 
by the AE A , was utilized to identify 
each student* * 

The month (indicated numerically) in 
which the child was born. 

The day (indicated numerically) on 
which the child was born. 

The year in which the child was born. 



Gender of child: 

It Male 

2: Female 

The major handicap of the child. 

01: Mentally Retarded 

02: Deaf 

03: Hard of Hearing 

04: Visuallly Handicapped 

OS: Emotionally Disturbed 

06: Orthopedic Handicap (Gross Motor) 

07: Other Health Impaired (Epilepsy) 

08: Specific Learning Disability 

09: Multiple Handicap 

10: Deaf/Blind 

11 : Speech Impaired 

The number of months that the child 
received intervention while still in 
the home. After. the child was iden- 
tified as disabled, either the therapist 
or teacher was involved in establishing 
an in-home program of therapy for the 
child to be carried out in conjunction 
with the par en 1 8 or responsible 
guardian . 

The number of months the child had been 
in the preschool for instruction and 
therapy • 



AEA recorda 



AEA recorda 



AEA recorda 



AEA recorda 



Teacher 



Teacher 



AEA records 



AEA records 
Teacher 
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3-D. 3 



CODE 
VARIABLE 


VARIABLE 


EXPLANATION OF DATA AND METHOD OF 
DATA COLLECTION 


SOURCE 


9) HRCEN 


HOURS/WEEK IN 
CENTER 


The avenge number of hours per week 
that the child spent in the preschool 
during the 1982-83 school year* This 
figure was derived from the regular 
weekly schedule information provided by 
the teachers* Ones the hours per week 
figure was ascertained, thst number was 
multiplied by the number of weeks in the 
school year, excluding the days during 
which there was no school* 


Teacher 


10) RTMI 


ROUND TRIP MILES 
FROM CENTER TO 
HOME 


The estimated number of miles the child 
traveled from home to the center and 
back* 


Teacher 


11) SERV 


SERVICE 


Indicate which type of preschool program 
the child is in by the following 
designation : 

1 s 1/2 day program 

2 = full day program 


AEA 


12) ST 


SPEECH THERAPY 


Whether or not the child is receiving 
any speech therapy: 

0 s no spsech therspy 

1 a spsech therapy 


Teacher 


13) PT 


PHYSICAL THERAPY 


Whether or not the child is receiving 
any physical therapy : 

0 s no physical therapy 

1 s physical therapy 


Teacher 


14) OT 


OCCUPATIONAL 
THERAPY 


Whether or not the child is rsceiving 
any occupational therapy: 

0 s no occupation therapy 

1 a occupational therapy 


Teacher 


15) HRHOMP 


HOURS SPENT BY 
PARENTS IN PRE- 
SCRIBED THERA- 
PEUTIC INTERVEN- 
TION 


The average number of hours spent by the 
parent or guardian of the child 
following the therapeutic directives of 
the teacher* This time includes both 
the hours reported by the teacher that 
the parent spends structured time with 
the child and the hoursthe teacher 
spends in the home providing instruction 
regarding intervention with the child* 
The teacher was able to provide this 
information based on parent self-report 
and degree of progress observed with the 
child. 


Teacher 




3-D.4 



code: 
variable 


VARIABLE 


EXPLANATION OF DATA AND METHOD OF 
DATA COLLECTION 


SOURCE 


16) HRHOMS 


HOURS SPENT BY 
STAFF IN THE HOME 
INSTRUCTING 
PARENTS ABOUT 
THERAPEUTIC 
INTERVENTION 


T he average number of hours spent per 
week by the teacher in the home of the 
child* During this time the teacher 
would illustrate both narratively and 
• by example what kind of treatment 
program should be carried out by the 
parenta* This information was reported 
by the teacher as a part of the regular 
weekly schedule data. 


Teacher 


17) TRANS 


MODE OF TRANS- 
PORT TO AND FROM 
CENTER 


The usual means of transportstion , ss 
reported by the teacher, utilized by the 
child to travel to and from the school. 
The three categories are: 

1: School Bus (Vsn) 

2: Psrsnts Trsnsport 

3: Both Bus snd Parents 

PERSONNEL TIME 


Teacher 


18) MAP 


MUSIC, ART , & PE 
INSTRUCTION AND 
PREPARATION TIME 


The amount of personnel time in hours 
spent in prepsring snd delivering music, 
art, snd PE instruction. These data 
were gathered from the weekly schsdule 
of instruction provided by the teacher. 
Hours per week were multiplied by the 
number of weeks of instruction 
accounting for days during which school 
was not held. 


Teacher 

School 

calendar 


19) TRANB 


AMOUNT OF TIME 
REQUIRED TO DRIVE 
SCHOOL BUS 


Data calculated for each child who 
utilized the bus ss transportation to 
and/or from school i 

Round Trip Miles ♦ MPH ( sn sversge 
of 40 MPH was utilized) X Number of 
Days of School 


Teacher 

School 

calendar 


20) TCH 


HOURS OF DIRECT 
INTERVENTION BY 
TEACHER 

- 


From the weekly schedule provided by the 
teacher, hours of direct intervention 
for each child were determined. Hours 
spent in a group with other children 
were pr ora t ea across cniiaron v s . g • , ju 
minutes' with five children is calculated 
to be t> minutes of DI with one child). 
The number of hours spent per week in 
this manner were multiplied by the 
number of weeks in the school year. 


Teacher 

School 

calendar 
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CODE 
VARIABLE 


VARIABLE 


EXPLANATION OF DATA AND METHOD OF 
DATA COLLECTION 


3-D.S 

SOURCE 


21) AID 


HOURS OF DIRECT 
INTERVENTION BY 
AIDE 


From the aide's weekly schedule provided 
by the teacher, hours of direct 
intervention for each child were 
determined (prorated as with teacher). 
The number of hours spent p?r week in 
this manner were multiplied by the 
number of weeka in the school year. 


Teacher 

School 

calendar 


22) SPCH 


HOURS OF DIRECT 
INTERVENTION BY 
SPEECH THERAPIST 


From the weekly schedules provided by 
the teacher , hours of direct speech 
therapy intervention for each child were 
determined (prorated as with teacher). 
The number of hours spent per week in 
this manner were multiplied by the 
number of weeks in the school year. 


Teacher 

School 

calendar 


23) PTOT 


HOURS OF DIRECT 
INTERVENTION BY 
PHYSICAL THERA- 
PIST AND OCCUPA- 
TIONAL THERAPIST 


From the weekly schedules provided by 
the teacher, hours of direct physical 
and occupational therapy intervention 
were determined (prorated as with 
teacher). The number of hours spent per 
week in this manner were multiplied by 
the number of weeks in the school year. 


Teacher 

School 

calendar 


• 




CONTRIBUTIONS 




24) CFAC 


THE COST OF AEA 
(AREA EDUCATION 
AGENCY) SPACE 


Since the AEA preschool administrators 
exist as an essential part .of providing 
aervice to the preschool children, the 
office apace they utilize is considered 
as an indirect cost of preschool opera- 
tion. Hence the amount of space in 
aquare feet used for this purpose was 
ascertained from the information 
provided by the administrative staff. 
An average yearly rental coat for squars 
foot of office space was then determined 
by contacting real estate agencies in 
the area and obtaining data on the 
current rate of renting office space in 
that vicinity ($<41/ft z ). The number 
of square feet in the administrative 
facility (19,068 ft 2 ) was multiplied 
by the average aquare foot cost of 
office space ( $ . 41/ f t 2 ) and a yearly 
cost WAS computed. That figure 
(17817. Bo; was then divided oy tne total 
number of preschool children served by 
the area education agency to obtain the 
cost per child of AEA office space 
($223/child) . 


AEA pre- 
school 
administra- 
tors, Faci- 
lity floor 
plans, Area 
real estate 
agents 




3-D. 5 



CODE 
VARIABLE 


VARIABLE 


EXPLANATION OF DATA AND METHOD OF 
DATA COLLECTION 


SOURCE 


25) 


CHOM 


COST OF HOME 
SPACE USED BY 
PARENTS AND STAJ-F 
DURING DIRECT 
INTERVENTION (AT 
HOME) 


Space at home ia necessary for 
therapeutic intervention with the child 
to take place in that milieu . Since 
several preschool programs actively 
encourage snd incorporate this type of 
ir>tervention 9 this too is considered as 
a contributed cost « To estimate the coat 
of home space, 2'real estate agencies 
were contacted. Inquiries were made 
regarding the aquare foot size and 
rental price for a middle class home 
with 3 bedrooms and a total of 1000 sq« 
ft* The yearly cost of utilizing this 
space was determined by using the 
agents' estimations on ths average coat 
for utilities ($100 /mo) and rent for a 
one thousand sq « f t . no me ($400 /mo ) « By 
dividing this figu 9 by the number of 
hours in one year v 87 6Q hrs/yr) , the 
cost per sq. ft* per hour waa determined 
($ .0006849/sq . ft. /hour)* Based then 
upon an average size living room 
(typically used work space) (300 sq. 
ft.) and the number of hours reported by 
teacher for home intervention for each 
child (0-9 hrs)* a cost for, home space 
was determined # Formula: 

# of hours/week used X cost/sq. 

ft./hr X # of sq. ft. X # of weeks 

of program 


Area real 
estate 
agents 
Teachers 


26) 


CfQUlP 


CONTRIBUTED 
EQUIPMENT 


Not considered in this study 




27) 


CPATR 


PARENT TRANSPOR- 
TATION COST 


For thoss children not transported by 
bus to the center, a contributed cost is 
incurred with the parent's time (oppor- 
tunity) and vehicle operation. To 
determine this figure, the number of 
round trip miles for each child to 
travel to and from the school was 
multiplied by 23fc, thus providing a cost 
for vehicle operation and gasoline. 
Added to this figure was the cost for 
parent time determined by dividing the 
round trip miles by an average speed of 
35 miles per hour (in town speed) and 
multiplying this figure by the salary 
per hour (average $5.04/hr) of a 
paraprofessional (market value of 


Teacher 
Administra- 
tor or Prin- 
cipal (hour- 
ly parapro- 
fessional 
rate) 
School 
calendar 




3-D.6 



CODE 
VARIABLE 


VARIABLE 


EXPLANATION OF DATA AND METHOD OF 
• • DATA COLLECTION 


SOURCE 






replacement coeb) In that particular 
school district ■ r insiiy • r*n*e r *gurs 
wss multiplied by ths numbs* of school 
dsys during which this tr snsportstion 
wss provided. Ths formula used is as 
follows: 

[(RT miles X 23b) + (RT milss ♦ 35 
MPH X Cost of Psraprofsssionsl/hr)] 
X ISO school dsys 




28) CPALUN 


COST OF LUNCH 
PROVIDED BY 
PARENT 

• & 


Bsssd upon informstion from the class- 
room tsschers, the childrsn in full-dsy 
programs who brought: lunch from home 
were identified. This rsprssents s 
contributsd cost for the parent. Ths 
cost of an individual lunch was deter- 
mined by obtaining the cost of a lunch 
in each school district. This cost wss 
rsported to be between 65 fc and 85 fc , 
depending on ths district. This 
cost/lunch then *ns multiplied by the 
number o* school days xn wnicn s luncn 
wss brought from horns. In cases where 
psrsrLs were eligible for purchasing 
reduced cost lunchss, only s percentage 
rf esch lunch wss charged to the parent 
(average of $ /lunch), and the rest of 
| ths cost wss sbsorbed by the federsl 
government • 


Tsachsrs 
Administrs- 
tors (oost 
of fsdsrslly 
funded lunch 
progrsm) 
School 
cslsndsr 


29) COTH 


CONTRIBUTED TIME 
FROM STUDENT 
AIDES 


In eome of the preechool progrsms, 
studsnts psrticipstsd in providing 
dirsct Intsrvsntion for college credit. 
Though sidss sre not paid by the school 
district for this experience, it repre- 
ssnts s contributsd cost ss the 
instructors incorporate the student s • 
services into part of the ongoing 
preechool program. Thie cost wss 
dstsrminsd by consulting ths weekly 
echedule of both the student aide and 
ths tsschsr The hours of involvement 
were multiplied by the hourly rate of 
psy for s psrsprof sssional (avsrage 
$5*Ql/hr) snd thsn multiplied by the 
number of weeke during which the 
studsnts were in the classroom. 


T esc hers 
Administrs- 
tor (Para- 
prof sssionsl 
sslsry) 
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3-D. 7 



^ ODE 
VARIABLE 


VARIABLE 


EXPLANATION OF DATA AND METHOD OF 
DATA COLLECTION 


SOURCE 


30) CAPRTH 


COST OF PARENT 
TINE TO CONDUCT 
DIRECT INTERVEN- 
TION 


The time the parents spend In their home 
providing ths prsscribed therspsutic 
intervention with their children cen 
aleo be determined to be a contributed 
cost. 

In sscerteinig this yesrly cost, the 
number of weekly hours spent with the 
cn 1 X o 18 mUlwipiieo D y w n o nu mo e r or 
weeks during the school yesr. This 
number of hours is multiplied by the 
hourly psrsprofsssionsl sslsry (sversge 
$5.04/hr) in thst psrticulsr school 
districts This rsprssents the contrib- 
uted cost of psrent intervention. 


Teacher 
Adminiatra- 
tor (Para- 
prof eaaional 
aalar y ) 
School 
calendar 


31) CGOVLUN 

t 


COST OF LUNCH 
PROVIDED BY 
FEDERAL FUNDS 


Certsin eligible children whose femilies 
sre of low economic ststus sre provided 
full or psrtisl (SOS to 1005) financisl 
support for their lunch. 

To determine this contributed cost, the 
full or psrtisl cost per lunch (326 to 
85fc) is sscsrtsined for each child 
receiving this support. This dsily cost 
is multiplied by the number' of school 
days ths child receives lunch. 


Teacher 
Adminiatr s- 
tor 


32) CSNAK 


COST OF PARENT 

CONTRIBUTED 

SNACKS 


Teschera encoursge psrents to provide 
snscks for ths children in both half-day 
and fu 11 -day pro grama • To determine the 
contributed coat of theae snscks , either 
the snscks or ths cost of snscks was 
ascertained from the teacher's report. 
For thoae that reported what the anacka 
were generally compriaed of, a specific 
vaxue was ■ooiynou wnoee r ooo stu i io uj 
contacting the local supermsrks ts • 
After the weekly 'cos t wss determined! 
thst figure wss multiplied by the number 
of weeks in the school program and 
divided evenly among all the children in 
the classrooms 


Teacher 
Food market 


CARD #2 








1) ID2 


IDENTIFICATION 
NUMBER 


This identification number is the same 
for each child as indicated on the 
initial card. 


AEA 




3 d.8 



CODE 
VARIABLE 


VARIABLE 


EXPLANATION OF DATA AND METHOD OF 
DATA COLLECTION 


SOURCE 






PERSONNEL COST 




2) PCDI 


TOTAL PERSONNEL 
COST FOR DIRECT 
INTERVENTION 


This repreeenta the cost for aach par- 
aonnal who providad diract inatruction 
(inatructor, aide, therapist a ) . The 
paraonnal time pravioualy datarminad for 
aach child for diract intarvantion by 
aach of tha abova named providara ia 
compiled by multiplying tha personnel 
tine apent with each child by their 
reapective hourly salariee. Thia figure 
repreaente the coat of all direct 
intervention received by the child. 


Teacher 
Adminiatra- 
tor (for 
aalariea) 


3) PCPREP 


TOTAL PERSONNEL 
COST FOR PREPA- 
RATION 


Thfa repreaente the coat for preparation 
for direct intervention by all thoae 
paraonnal (teacher, aide, therapiat) who 
provide auch. The pereonnel time 
required for each child for preparation 
ia determined from each of the weekly 
achedulaa and multiplied by the number 
of weeka in the achool year. Thia 
figure ia multiplied by their reapective 

then totalled to provide the total 
paraonnal coat for preparation* 


Teacher 

Adminiatra- 

tor (for 

aalary) 

School 

calendar 


4) PCTRV 


COST (SALARY) 
FOR TEACHER AND 
THERAPIST WHILE 
TRAVELING 


Tha amount of time epent traveling to 
children'e homea for weekly viaita 
(taachera) or to achool districts by 
AEA tharapiata ia determined from their 
weekly echedulee. Thia time ia 
multiplied by the number of weeka in tha 
achool year then by the hourly aalary of 
each. Theee amounta are totalled to 
repreaent tha coat for paraonnal during 
travel . 


Teecher 
Administra- 
tor (for 
aalary) 
School 
calendar 


5) PCAD 


COST FOR AEA • 
(AREA EDUCATION 
AGENCY) PERSONNEL 
FOR REGIONAL 
ADMINISTRATION 


The number of hoars apent weekly by the 
AEA administrative personnel in 
preschool related matters was provided 
by £hem. This weekly schedule was 
multiplied by the # of weeks they were 
involved in providing adminiatrative 
aervicea. The number of yearly hours 
was multiplisd by their hourly aalary 
and that amount was evenly distributed 
over each preschool child. 


AEA Adminis- 
trator 
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PERSONNEL COST 




6) PCPAR 


COST FOR TEACHER 

****** I I W li 1 b nw Mm m 

TIME IN INTER- 
FACING WITH 
PARENTS 


The numbftr of hour I nch faarhar ininfc 

1IIV liy MUv4 W ' IIUU A 9 W ■ W 1 1 U D ML II D 1 1U VII b 

with parent! waa provided in their 
weakly schedule. Thia number waa 
multiplied by number of weeks in the 
echool year. Thie total number of houra 
waa then multiplied by the respective 
ealary of each teacher. 


i oicn.ri 
Administra- 
tor (for 
salariee) 
School 
calendar 


7) PCSCAD 


COST FOR RIVER- 
SIDE SCHOOL 
ADMINISTRATION 

• 


Each echool had some administration 
costa (see Non-OI) assigned to the 
preachool for principal and aecretary. 
However | at Rivereide (half- day program) 
the preachool program had a coordinator 
in addition to the principal. This 
additional cost for coordinator * a time 
and secretary's time is calculated in 

f hii§ columns* Total hours war a mn 1 ¥ i •» 

b II 9. B WW A U IH* IB. | U L V m IIWU 4 V WQ4 9 HIU i b A 

plied by the number of weeks in the 
echool year, then by the hourly salary 
of the coordinator and aecretary. The 
total cost was then distributed evenly 
over each child in the half-day 
program. 


Teacher 

Adminiatra- 

tor 

School 
calendar 


8) PCSCRE 


COST FOR TEACHER 
TIME IN SCREENING 
CHILDREN IN PRE- 
SCHOOL PROGRAM 


The number of hours AEA personnel were 
engaged in screening activity waa 
provided on their schedules. This 
number of houra waa multiplied by their 
hourly salary and evenly distributed 
over each child in the ACA. 


ACA 

Administra- 
tor 


9) PCINS 


COST FOR TEACHER 
TIME IN RECEIVING 
TRAINING AND PAR- 
TICIPATING IN 
INSERVICE 


The number of hours the teachers engaged 

in tnio ■wLiviLj rbb prov lusu DOC n 

on their achedu lea and on the school 
calendar. After the yearly number of 
hours waa determined, it waa multiplied 
by their hourly ealary rate and 
diatributed evenly as cost over each 
child in that classroom* 


Teacher 

o c no o x 
calendar 
Administra- 
tor 


10) PCBUS 


COST FOR TIME 
BUS DRIVER SPENDS 
TRANSPORTING 
CHILDREN TO AND 
FROM CENTER 


The number of hours obtained previously 
in determining the time required to 
traneport those utilizing bus service 
was multiplied by the hourly ealary of 
the bus driver for each child* 


Teacher 
Administra- 
tor 

School 
calendar 
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11) 


PCCAPER 


COST FOR THE 
TEACHER TO CON- 
DUCT EVALUATION 
OF STUDENT PRO- 
GRESS (CAPER) • 


The number of houre indicated on the 
teacher's echedule for CAPER adminietre- 
tion wee multiplied by the hourly eelery 
rate for thet teecher end thet coet wee 
dietributed evenly over all children in 
thet cleeeroom. 

NONPERSONNEL COSTS 


Teecher 
Administra- 
tor 


12) 


TRANSC 


COST OF BUS OPE- 
RATION AND TRAVEL 
REIMBURSEMENT FOR 
THERAPISTS, CON- 
SULTANTS, AND 
TEACHERS 


The coet of opereting the echool bue per 
nile wee determined by contecting e 
local bue company contracted for thoee 
eervicee ($ . 06/mi/child) . The number of 
round trip milee for eech child wee 
multiplied by thet coet for eech of the 
n on — Hi w ■ r ■ id ■ nrnchool sitae. For 
Rivtreide that cost wee multiplied by 
the total number of round trip milee for 
all children and divided evenly over 
each child* Trevel reimbursement for 
therapists, consultants . and teachera 
waa baaed upon $*23/mi« 


Bue company 
Teecher 


13) 


EQPC 


COST OF EQUIPMENT 
PER CLASSROOM, 


An inventory of claaaroom equipment for 
each claaaroom was provided by either 
the teacher or principal/administrator. 
The coat of this equipment waa provided 
in this inventory. Where the cost was 
not provided, the depreciated value of 
claaaroom equipment was ascertained by 

Anne* maw* 4 mm 1 a m a 1 nmn nhanf ■ n r f h a r 

contacting i o c a i niBrcnante or tnat 
equipment. Salvage value was used for 
items thst were depreciated completely. 
The coat for individual it erne in each 
claaaroom was then totalled and 
distributed evenly over the number of 
children using the classroom. 


Teacher 
Principal/ 
Adminiatrs- 
tor 

Rstail eales 


14) 


FACC 

* 


COST OF FACILITY 
INCLUDING MAIN- 
TENANCE AND 
INSURANCE 


Coat of each facility was either provid- 
ed by the adminiatr ator (in terms of 
cost to rsnt/yr) or detsrmined by con- 
tacting local real eetate appraisers who 
couio provide an estimate or yearly 
rental coet for each facility. Informa- 
tion regerding the proportion of the 
entire fecility utilized by the partic- 
ular claae under study waa provided by 
the individual teacher. That proportion 
of aquare footage was multiplied by the 


Adminietr a- 
tor 

Real estete 
appr aiaere 
i o a c n e r 
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previously obtained cost/sq. ft. of the 
facility. That sane proportion wee 
utilized in determining coet of insur- 
ance end Maintenance, figures which were 
provided by the adminietr ator . The 
proportional coat of facility, ineurance 
end meintenence was totalled end thet 
coet waa divided evenly over each child 
in thet particular clsasroom. 








DIRECT INTERVENTION COSTS 




15) DIMAP 


DIRECT INTERVEN- 
TION COSTS FOR 
EACH CHILD FOR 
MUSIC, ART , & 
PHYSICAL EDUCA- 
TION INSTRUCTION 


The smount of direct intervention with 
eech child wee obtained from the weekly 
schedules provided by clsssroom teech- 
ers* The number of hours per week of 
theee activitiee wee multiplied by the 
reepective hourly sslsry rites. Thet 
amount waa multiplied by the number of 
weeka of instruction during the year. 


Teacher 
Administrs- 

tor 

School 
calendar 


16) DITCH 


DIRECT INTERVEN- 
TION COSTS FOR 
EACH CHILD FOR 
PRIMARY TEACHER 
INSTRUCTION 


The number of houre of direct interven- 
tion provided esch child by the primsry 
teecher ee indiceted on the weekly 
schedule waa multiplied by the hourly 
sslsry rste of thst psrticulsr tescher. 
Thst smount was multiplied by the number 
of weeks of instruction during the 
yesr . 


Teacher 
Adminietr e- 
tor 

School 
calendar 


17) DI AID 


DIRECT INTERVEN- 
TION COS'; FOR 
EACH CHILD FOR 
TEACHER AIDE 
INSTRUCTION 


Ths number of hours of direct interven- 
tion provided esch child by the aide ae 
indiceted on the weekly achedule wee 
multiplied by the hourly salary rate of 
thet particular aide. Thet emount 
wee multiplied by the number of weeks of 
instruction during the yeer. 


Teecher 

Administrs- 

tor 

School 
cslendsr 


18) DISPH 


DIRECT INTERVEN- 
TION COST FOR 
EACH CHILD FOR 
SPEECH THERAPY 


The number of hours of direct interven- 
tion provided esch child by the epeech 
therspist ss indicated by the weekly 
schedule wss multiplied by the hourly 
eelsry- rete of thet perticuler speech 
therspist. Thst smount was multiplied 
by the number of weeks of inetruction 
during the year. 


Teecher 
Administra- 
tor 

School 
cslendsr 
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19) DIPOT 



20) NONDI 



21) CONTRAV 



22) CONIN 



23) CONE V AL 



ERLC 



DIRECT INTERVEN- 
TION COST FOR 
EACH CHILD FOR 
OCCUPATIONAL AND 
PHYSICAL THERAPY 



COST FOR SERVICES 
OF PRINCIPAL AND 
SECRETARY OF THAT 
FACILITY WHERE 
PRESCHOOL CLASSES 
WERE HELD 



COST FOR THE CON- 
SULTANT TO THE 
PRESCHOOL TO 
TRAVEL TO AND 
FROM THAT SCHOOL 



COST FOR THE CON- 
SULTANT TO THE 
PRESCHOOL TO 
PROVIDE INSERVICE 



COST FOR THE CON- 
SULTANT TO THE 
PRESCHOOL TD CON' 
DUCT STUDENT 
EVALUATIONS 



The number of hours of direct interven- 
tion provided each child by the phyaical 
and /or occupational therapist as 
indicated by the weekly schedule was 
multiplied by the respective hourly 
salary rates of those therapists. Thst 
amount was multiplied by the number of 
weeks of instruction during the year* 

Yearly salaries for both the principsl 
and secretary of the school whsre the 
preschool was held were obtained from 
the administrator of each school 
district. The proportion of preschool 
children to total number of children in 
the school waa utilizsd in determining 
the amount of each salary required for 
administration of the preschool* This 
amount was then divided evenly over the 
number of children in the preschool. 

The number of hours during which the 
consultant traveled to and from each 
preschool as indicated by the weekly 
schedule was multiplied by the hourly 
salary rate of that consultant* That 
amount was multiplied by the number of 
weeku of instruction during the year and 
distributed evenly over each child in 
that particular preschool. 

The number of hours during which the 
consultant provided inservice to the 
teacher and aide of the preschool as 
indicated by the consultant's weekly 
schedule was multiplied by the, hourly 
salary rate of that consultant* That 
amount was multiplied by the number of 
weeks of instruction during the year and 
distributed evenly over each child in 
that particular preschool. 

The number of hours during which the 
consultant conducted student evaluations 
ao indicated by the consultant* weekly 
schedule was multiplied by the hourly 
salary rate of that consultant* That 
amount was multiplied by the number of 
weeks of instruction during the year and 
distributed evenly over each child in 
that particular preschool 



Teacher 

Administra- 

tor 

School 
calendar 



Administra- 
tor 

Principal 



Teacher 
Administra- 
tor 

School 
calendar 



Teacher 
Administra- 
tor 

School 
calendar 



Teacher 

Administrs< 

tor 

School 
calendar 
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IOWA 3-E.2 

CO ONLY 





ALL (N s 22) 


HALF (N s 11) 


FULL (N s 11) 


VARIABLE 




SD 


X 


SD 


X 


SD 


C. AGE 


56.2727 


8.9612 


.57.9091 


9.1701 


54.6364 


8.8687 


MONTHS IN HOME B . 


.8182 


2.1300 


.5455 


1.8091 


1.0909 


2.4680 


HOS. IN CENTER B 


14.1818 


6.5366 


14.6364 


7.2563 


13.7273 


6.0513 


HOURS PER WK. 
CENTER 


21.6773 


9.2168 


13.4727 


.8673 


29.8818 


5.43 60 


RT MILES 


13 £364 

X */ • OH 


6.7862 


10 . 6364 

AW w w^ 


4. 1297 


16.6364 


7.73*6 


HOME HOURS PER 
WK. PARENT 




4 * wV •» * J 


1 .4727 


. 8650 


2.6636 


2.8588 


HOME HOURS PER 
WK. STAFF 




. 1217 


.0000 


.0000 


.0727 


.1679 


HRS. OF MUSIC, 
ART, & PE 


9 5 A 5 5 

£ • «7 H «7 «7 


2.5019 


4.4545 


. 8202 


.6364 


2.1106 


HRS. OF INDIV. 
BUS DRIVING TIME 


47*9545 


32.9509 


46.5455 


24.1965 


49.3636 


41.1127 


DI HOURS OF 
TEACHER 


go 9 9 71 


S9 AA76 

y4 i HO / O 


58. S1S2 

w# w . g 4 (14 


15 .1909 


137.6364 


46.1893 


DI HOURS OF AIDE 


87.9091 


60.9605 


50.4545 


29.6188 


125.3636 


61.9714 


DI HOURS OF ST 


26.2273 


12.6413 


33.7273 


11.8498 


18.7273 


8.4509 


DI HOURS OF PTOT 


5 £1 £A 

«7 • O; OH 


11 0950 


9 . 7273 


14.7044 


1.5455 


2.3394 


CONTRIBUTED COST 
OF HOME SPACE 


15 0000 


16.3328 


9.63 64 


4.9249 


20.3636 


21.7406 


CONTRIBUTED COST 
OF PARENT TRANS. 


173.6364 


369.7780 


46.2727 


153.4693 


301.0000 


477.3940 


CONTRIBUTED COST 
OF LUNCH - PARENT 


44.7727 


61.1578 


.0000 


.0000 


89.5455 


58.6896 


CONTRIBUTED OTHER 


27.5455 


70.9525 


.0000 


.0000 


55.0909 


94.3541 


CONTRIBUTED COST 
OF PARENT TIME 


630.9091 


1482.9527 


316.1818 


184.2481 


945.6364 


2089.5808 


CONTRIBUTED COST 
OF LUNCH GOVT. 


18.6364 


48.4705 


.0000 


.0000 


37.2727 


64.5726 


CONTRIBUTED COST 
OF SNACK PARENT 


20.1364 


36.1719 


8.1818 


1.8878 


32.0909 


49.2919 
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3-E.3 



VARIABLE 


ALL (N x 22) 


HALF (N a 11) 


FULL (N a 11) 


x 


SD 


x 


so 


x 


SD 


PERSONNEL COSTS 
01 


2118 . 3636 


533 . 2670 


2000.8182 

mm \m %m %m m W m\ W a* 


365 . 1761 

mf O ✓ . A # O A 


2235 9091 


658 . 3570 


PREP 


671.4091 


193.3929 


758 • 4545 


127.2292 

A. AW • S* 1*7 I* 


584 3636 

✓ H *9 f V U mf O 


213 7411 


TRAVEL 


439.6818 


231 . 1972 


379 . 0909 

^ # 7 % \3 7 \3 7 


127 . 2261 


500. 2727 


296 . 6247 

At < a « a At *. / 


ADMIN-AEA 


1655.0000 

mm \M w w . W W W W 


. 0000 


1655 . 0000 


. 0000 


1655 . 0000 

x a 7 7 . u u u u 


i UUUU 


PARENT CONTACT 


89. 8182 


101 .0684 


95 . 0000 


109. 1467 


84 . 6364 

W "9 . Q ^ Q "9 


97 . 3604 


RIVERSIDE - AD 


142.2727 


151.9064 


284 .5455 


62 . 6680 

OA. . OQWU 






SCREENING 


1 .3636 


3.5125 


• oooo 


. 0000 


2 . 7273 

mm * 9 At i mf 


4.6710 

— ■ — * 


INSERVICE 


73.0000 


22.3522 


76.1818 


25.2064 


69.8182 


19.7880 


BUS DRIVING 


255 . 4545 


157.5720 

mm ✓ f * ^ r 4 U 


285 .8182 

m* W m* . V A O 4* 


115.5550 

A A / . 7 7 7 \J 


225 0909 

****** . \J 7 \J 7 


191 797A 

mm 7 mm • f L 1 O 


CAPER 


135.9091. 


76.1533 


149 . 6364 


48.4794 


122. 1818 

X At At . A W A W 


97 0246 

✓ # • W At *9 O 


NC COSTS 
TRANSPORTATION 


144.7727 


147.2251 


104.5455 


34.6738 


185.0000 


201.8802 


EQUIPMENT 


440 .4091 


210. 0600 

mm mm Smi . W W W w 


544 . 4545 


1 32 .5499 


336. 3636 

7 7 SJ • 7 O 7 O 


226- 4453 

At At O « mf m* 


FACILITIES 


590.7273 

✓ 7 w • t *» t mf 


182-3597 

m\ SJ 4m • J S 7 1 


519 .7273 

J m\ 7 • 1 4m 1 7 


113 7393 

AAV. 9 7 7 7 


7271 

DDI 1 # mm 1 J 


9 1 A 0999 


Ox COSTS 
MUSIC, ART, PE 


33 .2273 

mf mf t 4m 4m t mf 


35.1432 

mf m* • A, "9 mf At 


59. 7273 

*f 7 % f 4m f mf 


2 1 . 4695 

tm 7 * HO/^ 


6 7273 

O . 1 tm 1 mf 


22 .3119 

At At . mf m\ mm W 


PT/OT 


64. 0455 


121 • 2496 


101 .1818 


1 61 . 6006 


26 . 9091 

At O • 7 W 7 A 


Al 59AA 
Hi i ✓ a; h o 


AIDE 


465 .2273 


224.0689 

mm mm *▼ . W W W ✓ 


'436 . 6364 

•9 7 W . Q ✓ W *9 


215 1350 


A91 9192 

*9 7 mf • OlOi 


919 A9A9 

m* J 7 • *9 O *♦ O 


ST 


328.7727 


166.2095 


375 .3636 


184.5981 


282.1818 


138.4260 


TEACHER 


1235.1818 


519.6575 


1042.9091 


86.4227 


1427.4545 


691.5866 


NON DI COSTS 


321.5909 


101.8139 


359.0000 


. 0000 


284.1818 


136.7112 


CONSULTANTS 
TRAVEL 


74.5000 


53.7434 


31 .1318 


13.7755 


117.8182 


41.8039 


INSERVICE 


71.5909 


81.3573 


84.0000 


114.8939 


59.1818 


18.9885 
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3-E.4 



VARIABLE 


ALL (N = 22) 


HALF (N s 11) 


FULL (N s 11) 


X 


SO 


X ' 


SO 


X 


SD 


EVALUATION 


9.0909 


19.7386 


.0000 


.0000 


18.1818 


25.2262 


HOURS/YR THERAPY 


31 . 8636 


17.5344 


43 . 4545 


16.7115 


20 . 2727 


8.4154 


HQURS/YR INSTRUC- 
TIONAL STAFF 


220 .5455 


92 . 1287 


157 .1818 


44. 5305 


283.9091 


83.7155 


HQURS/YR ALL 
STAFF 


268 . 5000 


90 . 8650 


203 . 7273 


43 .8819 


333 . 2727 


78.6309 


CONTRIBUTIONS - 
PARENT 


84.4545 


1549.6866 


380.2727 


192.9674 


1388.6364 


2108.7283 


TOTAL 

CONTRIBUTIONS 


1155.6364 


1585.7319 


605 .2727 


192.9674 


1706.0000 


2139.3759 


TOTAL 
PERSONNEL 


5 582.2727 


819 . 0678 


5684 . 5455 


709 . 4587 


5480 . 0000 

tW ~ W V V \mW V V V 


939.4084 


NON-PERSONNEL 


1175.9091 


429.8180 


1168.7273 


262.2301 


1183.0909 


564.8746 


TOTAL 01 


2126.4545 


522.3702 


2015.8182 


339.2344 


2237.0909 


656.5207 


TOTAL 

CONSULTANT 


155.1818 


98.4526 


115 .1818 


118.9738 


195.1818 


51.7722 


TOTAL 


8069.0000 


1893.7257 


7573.7273 


839.9482 


8654.2727 


2507.1601 


TOTAL COSTS 


177,518 




83,311 




94,207 





ERjc BEST COPY AVAILABLE 



ho only BEST COPY AVAIUBIE s-e.s 





ALL (N = 30) 


HALF (N 's 15) 


FULL (N = 15) 


VARIABLE 


X 


SD 


X 


SD • 


X 


SD 


C. AGE 


61.6333 


8.7197 


60.8000 


7. 9391 


62.4667 


9.6427 


MONTHS IN HOME 


1 .3000 


3.2605 


1.6667 


3.7922 


.9333 


2.7115 


MONTHS IN CENTER 


14.6667 


7.1743 


14.8000 


6.7210 


14.5333 


7.8364 


HOURS PER WK. 
CENTER 


22.2667 


.9.2180 


13.7867 


1.1307 


30.7467 


4.5433 


RT MILES 


11 .1000 


9.3600 


9.6667 


4.0999 


12.5333 


12.6596 


HOME HOURS PER 
WK. PARENT 


2.1133 


2.1866 


1.6200 


1.7628 


2.6067 


2.5050 


HOME HOURS PER 
WK. STAFF 


.1500 


.3972 


.0000 


• 

.0000 


.3000 


.5278 


HRS. OF MUSIC, 
ART, & PE 


2.8333 


2.6403 


4.7333 


. 7988 


.9333 


2.4631 


HRS. OF INOIV. 
BUS DRIVING TIME 


41 .5333 


42.5609 


40.5333 


22.5574 


42.5333 


56.9321 


01 HOURS OF 
TEACHER 


108 .1000 


51.7283 


69.3333 


• 

23.6995 


146.8667 


41.9606 


DI HOURS OF AIOE 


82.6667 


61.2948 


51.4667 


30.8658 


113.8667 


68.8755 


01 HOURS OF ST 


12.5000 


12.9528 


11.4000 


12.9494 


13.6000 


13.3138 


DI HOURS OF PTOT 


6.4667 


12.7028 


8.2000 


15.9428 


4.7333 


8.5S13 


CONTRIBUTED COST 
"F HOME SPACE 


15 .6667 


16.3840 


11.4000 


12.4028 


19.9333 


19.0581 


CONTRIBUTED COST 
OF PARENT TRANS. 


97.7000 


226.8038 


39.2667 


152.0791 


156.1333 


275.8793 


CONTRIBUTED COST 
OF LUNCH - PARENT 


51 .3667 


69.5208 


.0000 


. 0000 


10 2.7333 


66.0113 


CONTRIBUTED OTHER 


6.7333 


36.8800 


.0000 


. 0000 


13.4667 


52.1562 


CONTRIBUTED COST 
OF PARENT TIME 


380.3667 


364.3799 


319.0667 


306.6821 


441.6667 


415 .8402 


CONTRIBUTED COST 
OF LUNCH GOVT. 


16.1667 


42.2114 


.0000 


.0000 


32.3333 


55 .9536 


CONTRIBUTED COST 
OF SNACK PARENT 


10.9333 


5.7110 


6.2667 


. 7037 


15.6000 


4.5166 


PERSONNEL COSTS 
DI 


2151 .9000 


789.4186 


1694.2000 


545.2627 


2609.6000 


738.0103 


CTEP 


591 . 2667 


' 228.0888 


581.3333 


144.5504 


601 . 2000 


294.3786 


y£ 
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3-E.6 



IOWA 
MD ONLY 



VARIABLE 


ALL (N > 30) 


HALF (N a 15) 


FULL (N a 15) 


V 
A 


911 


A 


cn 
SU 


y 
A 


SO 


ADMIN-AEA 


i t ct nnnn 

i 0)2 J < uuuu 


nnnn 
. uuuu 


1 63 3 « UUUU 


nnnn 
• UUUU 


1 / c c nnnn 
165 5 «0000 


A A A A 

.0000 


PARENT CONTACT 


57.2000 


88.9360 


.0000 


.0000 


114.4000 


96.8148 


RIVERSIDE - AD 






9ift nnnn 
2 3U • uuuu 








SCREENING 


i ooo / 


4 • 7 J 1 1 


nnnn 
• UUUU 


nnnn 
• UUUU 


1 n 1 1 
1.3333 


1 CI 01 

3.5X87 


INSERVICE 


X9 ft££7 


91 £A79 
LJ • DO / A 


ao £nnn 
40 • oUUU 


to 1 9 1 A 
1 7 « 17 1 4 


77.13 33 


11a icq a 
338 .5524 


BUS DRIVING 


229.1333 


197.2792 


248.9333 


141.9479 


209.3333 


244.1901 


CAPER 


12 8 • 73 33 


7 < 10 A ft 


OA Kill 


3 2 • 1511 


163.3333 


90 • 5646 


NC COSTS 
TRANSPORTATION 


ill nui 

111 « U 3 3 3 


1 ft A 117ft 
1U 4 • 3 1 / U 


1 n7 1111 

1U / • j j j j 


9 0 £ O 9 O 

2 7 • 692 7 


1 1 A 9111 

114.73 33 


1 A 9 nil ^ 

147 .0726 


EQUIPMENT 


421 • U J J J 


1 £fl 9QftO 
1 OO « 27U 7 


Ail a n n n 
421 • 4000 


AO A ft 9 O 

4o • 402 0 


420 • 6667 


237 .3258 


FACILITIES 


5 4 7 • 7;J; 


9 A 1 A 1 1 1 
2 4 3 « 43 31 


a 1 a <innn 
414 • 2000 


41 • 7462 


685 .6667 


Afli K1C1 

285 . 5353 


DI COSTS 
MUSIC, ART, PE 


40.2667 


36.2595 


70.6667 


8.0682 


9.8667 


26.0381 


PT/OT 


0 / t 3 O 0 / 


ion 9 9 0 0 

1 7U • 2277 


07 . 0667 


232 .UU4Z 


86.0667 


1 a c MQin 
145 • 2940 


AIDE 


413.3333 


256.5867 


322.3333 


164.5660 


504.3333 


302.5708 


ST 


163.1000 


184.8519 


130.2000 


172.9142 


196.0000 


196.3732 


TEACHER 


1451.2000 


691.1789 


1090.1333 


287.3365 


1812.2667 


792.2470 


NON DI COSTS 


328.7333 


94.5979 


359.0000 


.0000 


298.4667 


128.7389 


CONSULTANTS 
TRAVEL 


62.1667 


69.5052 • 


10.2667 


13.7137 


114.0667 


63.6154 


INSERVICE 


57.7667 


77.3031 


49.4667 


108.5231 


66.0667 


21 . 2954 


EVALUATION 


6.6667 


17.2873 


.0000 


.0000 


13.3333 


22.8869 
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MO ONLY 

■ ( 



VARIABLE 


ALL (N s 30) 


HALF (N a 15) 


FULL (N s 15) 


x 


SO 


X 


SO 


x 


so 


HOURS/YR THERAPY 


18.9667 


18.2312 


19.6000 


19.5733 


18.3333 


17.4506 


HOURS/YR INSTRUC- 
TIONAL STAFF 


212.5997 


91.8937 


145.1333 


52.5953 


280.000 


70.5813 


HOURS/YR ALL 
STAFF 


254 . 1000 


92 .8604 


185 . 6667 


45 . 5548 


322 .5333 


75.8390 


CONTRIBUTIONS - 
PARENT 


556.0333 


444.8373 


376.0000 


365.2287 


736.0667 


455.0258 


TOTAL 

CONTRIBUTIONS 


803.9333 


457.3070 


601 .0000 


365.2287 


1006.8667 


459.9454 


TOTAL 
PERSONNEL 


5442.9667 


1229.2514 

1 


4789.4667 


785.3824 


6096.4667 


1264.1566 


NONPERSONNEL 


1082.0000 


392.4449 


942.9333 


96.2537 


1221.0667 


517.9963 


TOTAL 01 


2155.4667 


784.8301 


1702.4000 


539.4693 


2608.5333 


738.2371 


TOTAL 

CONSULTANT 


126.6000 


119.2348 


59.7333 


119.8460 


193.4667 


74.1975 


COST 


7455.5000 


1609.2904 


6393.1333 


986.4154 


8517.8667 


1404.6797 


TOTAL COSTS 


223,665 




95,897 




127,768 





4 
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BI5ST- COPY 

i 



Sample Floor. Plan 




>2o 



\ evir |- 



19' 



So 
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3-F.l 



Introduction to 



SECTION II 



Cost Data 



Section II is divided into three subsections: 

1.0 Cost Data Collection 
2.0 Cost Data Analysis 
3.0 Cost Data Summary 

Forms are provided and explained within each subsection so that the 
user may gather, disaggregate, and examine from several perspectives, the 
cost data from each alternative program under consideration. The infor- 
mation collected and analyzed in subsections 1.0 and 2.0 will be handled 
separately for each site under the various program alternatives. In 
subsection 3.0, all alternatives will be combined into single forms 
for summary and comparison. 
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Introduction to 



SUBSECTION 1.0 
Cost Data Collection 



i»n 



are data 
e site 



All forms Included 1n the package labeled [SUBSECTION L 
collection forms for use b y persons w ho collect cost; aaw at 
level. Data collected on IFORMS 1.01 will be analyze d using pac kage 
and summarized with other program alternatives using 



The attached [FORM 1.01 , indicates the title of each form, specifies 
the person who typically will provide the information, and the number of 



forms to be completed at each site. One entire set of IFORMS 1.01 will 



be used to collect data for each site within each program alternative. 
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CONTENTS OF COST DATA COLLECTION 
(SECTION II) 

( 



SUBSECTION 


FORM 


TITLE 


PASE 
NUMBER 


1.0 


1.0 


Introduction to Cost Data Collection 




1.1 




Personnel Expenses 






1.11 


Staff Sal ary/ Demographies 






1.12 


Consultant Schedule 




1.2 




Staff Schedules 






1.21 


Weekly Schedule - Direct Service 






1.22 


Weekly Schedule - Indirect Service 






1.23 


Exceptions to Weekly Schedule 




1.3 


1.30 


Child Demographies 




1.4 




Transportation of Children 






1.41 


Child Transportation Data 






1.42 


Vehicle Expenses 






1.43 


Parent Reimbursement 




1.5 




Equipment 






1.51 


Classroom Equipment 






1.52 


Administration Equipment 






1.53 


Equipment Costs 




1.6 




Staff Travel 






1.61 


Home Servicer Schedule 






1.62 


Staff Reimbursement 




1.7 




Other- Expenses 






1.71 


Telephone 






1.72 


Suppl ies 
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CONTENTS OF COST DATA COLLECTION 
(SECTION II) 



SUBSECTION 


FORM 


TITLE 


rAbt 

NUMBER 


1.8 




Facilities 






1.81 


Floor Plan 






1.82 


Facilities Costs 




1.9 




Contributions 






1.91 


Parent Intervention Time-Home/Cen. 






1.92 


Parent Transportation of Chili 






1.93 


Parent Food 





o 
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I FORM 1.0 I 



DATA COLLECTION 



FORM 
NUMBER 


TITLE 


WHO PROVIDES 
INFORMATION? 


HOW MANY FORMS 
WILL BE COMPLETED 
AT EACH SITE? 


1.11 


Staff Salary/Demo- 
qraphlcs 


Administrator 


1 per site 


1.12 


Consultant Schedule 


Administrator & 
Secretary 


1 per site 


1.21 


Staff Schedule Direct 
Service 


Each staff who pro- 
vides some direct 
Intervention weekly 


1 per direct 
service provider 


1.22 


Staff Schedule Indirect 
Service 


Each staff who pro- 
vides no direct 
Intervention weekly 


1 .per Indirect 
service provider 


1.23 


Exceptions to Weekly 
Schedules 


Each staff who pro- 
vides no direct 
Intervention weekly 


1 per Indirect 
service provider 


1.3 


Child Demographics 


Administrator, Secre- 
tary, or Teacher 


1 per teacher 


1.41 


Ch1 Id Transportation 
Data 


Teacher 


1 per teacher 


1.42 


Vehicle Expenses 


Administrator/Secre- 
tary 


1 per vehicle 


1.43 


Parent Reimbursement 


Administrator/Secre- 
tary 


1 per site 


1.51 


Classroom Equipment 


Teacher 


1 per room 


1.52 


Administration Equip- 
ment 


Secretary 


1 per room 


1.53 


Equipment Costs 


Administrator 


1 per site 


1.61 


Home Service Schedule 


Home Visitor 


1 per visitor 


1.62 


Staff Reimbursement 


Administrator/Secre- 
tary 


1 per site 


1.7 


Other expenses 


Administrator 


1 per site 


1.81 


Floor Plan 


Secretary 


1 per site 


1.82 


Facilities Cost 


Administrator 


1 per site 


1.9 


Contributions 


All Staff 


1 per staff 
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FORMS 1.1 



PERSONNEL EXPENSES 



The personnel forms are divided Into two sections: 



FORM 1.11 



an hou 



Staff salary/demographics - persons who are employed on 



riy, weeKiy, monthly, or yearly basis. 



for a 



FORM 1.12 



Consultant schedule - nonstaff who receive compensation 
specific service performed once or infrequently during the school 
year (e.g., substitute teachers, psychologists, therapists, content area 
specialists, speakers, evaluators, tax specialists). 
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DIRECTIONS FOR 
I FORM l.lff 



STAFF SALARY 



Fill In the name of the site. List each paid staff person on r"Form 1.1 1 
according to the directions below for fllllnq In each column. 

A. STAFF NAME 

List the first and last name for each paid staff person who works for and 
1$ paid by this program, either full of part time. Do not Include those staff 
who work entirely for another program, such as Head Start. Typically, staff 
will Include the following: 



director 
administrator 
head teacher 
teacher 



paraprofesslonal 
aide ••■-J 
home visitor 
board member 



bookkeeper 

secretary 

clerk 



OT 
PT 

speech therapist 
nurse 



bus driver 
custodian 
food service 
worker 



B. POSITION 



Give a descriptive title for each staff person. For Instance, use 
"bookkeeper" instead of "administrative assistant" If that *s the major function 
performed. 



C. HIGHEST DEGREE 



Indicate the last educational degree earned and the field of endeavor. For 
example, list B.S. -Special Education or H.S, -Vocational . Also Include any 
special certifications received, such as preschool certificate, 

D. YEARS EXPERIENCE 



Indicate the nunber of years the person has oerformed related tasks. For 
Instance, a teacher might have 2 years elementary and 1 year preschool teaching 
with handicapped children. An administrator might have 2 years reqular teachlnq 
and 1 year as public school principal. 

E. FTE (Full Time Equivalent) 

Indicate the portion of Full Time Equivalent (FTE) for which each person 1s 
hired. If time 1s divided between two or more programs, list the FTE allotted 
to only this project. A full time person would be M 1.0", a half-time person, 
\5'\ and a person working 10 hours a week (10/40), \25". 

F. SALARY; PER 

List the compensation earned for the largest contractual unit. For 
example, If a teacher Is hired for a 10-month period, salary mlqht be listed as V 
"$15,000/10 mo. 11 An aide paid by the hour might be listed as "S6.00/1 hr. " For 
staff who work only partially for this proqram (and the rest of the time for 
another project), list only the salary paid by this program. 

G. PERIOD OF EMPLOYMENT 



List the expected length of service to your program, by month and day, for 
the current funding year. For hourly workers who are hired for the school year; 
time period should be from the beglnnlnq to the end of the program (school 
year). • 

H. EXPECTED WAGES 



Indicate total amount of money (In wages) to be paid from the beginning of 
the funding year to the end of the funding year. Do not Include frlnqe 
benefits. ' 

I. BENEFITS 

List the percentaqe of salary or the actual amount of fringe benefits for 
the school year. Include FICA, health, life, and dental Insurance. List other 
benefits (e.g., tax sheltered annuities, workman's compensation, unemployment) 
1n the other column. Remember that part time employees often receive reduced or 
no benefits. 

J. TOTAL SWB 

Add toqether columns H and I to compute the total salary, waaes, and 
benefits (SWB). 

™k 401 BEST COPY AVAILABLE 
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I FORM 1.11 | 
STAFF SALARY/DEMOGRAPHICS 

S1»e 



A 

STAFF NAME 


B 

POSITION 

I V»J 1 1 1 Wit 


c 

HIGHEST 
DEGREE 


D 

YEARS 
EXPERIENCE 


c 

FTE 

1 Ik 


F 

SALARY PER 


6 

PERIOD OF 
EMPLOYMENT 


H 

EXPECTED 


I 

BENEFITS 


J 

TOTAL 
SWB 


FROM TO 


WAGES 
FOR YEAR 


FICA 


HEALTH 


LIFE 


DENTAL 


OTHER 








































1 


1 


























1 


1 


























1 


1 
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DIRECTIONS FOR 



FORM 1.12 



CONSULTANT SCHEDULE 



This form is used to indicate nonstaff persons who received compensation 
for services rendered. 

A. Consultant Name . List the name of the consultant hired. 

B. Type of Service . Indicate what type of service the consultant performed 
for the program (e.g., assessment, therapy, tax service, inservice, 
building, repair). 

C. Length of Service . Give the number of days of service or indicate 
when service started and ended. If service has not been completed, 
estimate the date of completion. 

D. Expected Service Days . Indicate actual or estimated number of 8 hour 
days or parts of days for which the consultant will be paid. 

E. Expected Compensation . List the total amount of money paid to the 
consultant fo r services. If part of the services was donated, include 
that time on jFQRM 1.97] , Contributions . 



F. Specific Children . If the consultants work directly related to only 

specific children (e.g., psychological assessment or inservice with 

only their teacher), then indicate the ID numbers of the children 
involved. 
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I FORM 1.12 I 

Site CONSULTANT SCHEDULE 



A 

Consultant 
None 


B 

Type of 
Service 


c 1 
Length of 1 
Service 


D 

Expected 
Service Oaya 


E 

Expected 
Compensa- 
tion 


F 

Specific Children 
(ID la) 






































































































































• 
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FORMS 1.2 



STAFF SCHEDULES 



To estimate the number of staff hours spent per year on various aspects 
of the program, staff are asked to complete two forms: weekly activities 
and exceptions to weekly activities. Separate weekly activiti es forms 
are provided for two gro ups of staf f; Direct service staff, IFORM 1,211 and 
indirect service staff, IFORM 1.221 . 

Direct service staff are defined as anyone in direct contact with a 
child (e.g., instruction, transportation, therapy) for any part of the 
week. Indirect service staff do not intervene with the children in any 
way and are usually administrators and clerks. 

Weekly activity forms should be filled in to illustrate the activities 

of a typical week. Activities which occur on a biweekly or monthly 

schedule should be prorated and the amount of time for only one week 
can be included on the weekly schedule. 



The exceptions, IFORM 1.221 , to the weekly schedule include holidays 
and events at the beginning and end of the school year. At these times, 
the children will attend the center, but no formal intervention is being 
conducted. Instead, most time is devoted to pre- and posttesting or to 
large group activities. 
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DIRECTIONS FOR 



I FORM 1.21 I 
WEEKLY SCHEDULE - DIRECT SERVICE 



To epecify the typt of aetivitiee which eteff ere usually involved with throughout the yeer, 
■aeh dlroct •■■rvlct or ovldar cowole too e weekly echedule. Piece eteff no* (or ID #) it tht top 
of Moh page. Um quo 1 FORM 1.21 1 If your echedule la generally the eeaa every week. If weekly 
eotlvltlea vary elightly, liet the ectlvltlea ueuelly engeged i n for e tvo leal week. If you work 
on e aonthly echedule (e.g., hoae vleltor), then fill out four 1 FORM 1.21 1 to show how tiae la 
epent during e typical Month. Do not Include ectlvltlea aeaocleted with other projects (e.g., "* 
Heed Start)} indicate only intervention conducted for the project being analyzed. . 



Code I FORM 1.21 1 in the order of categori es, ee lietad below. Follow the directions end 
deflnitione in entering inforaetion. A ea»ol« t FORM 1.21 I hss been Included to illuattate how 
tiaa can be divided into block •. Follow the etepe below. 

A. Firet, et the top of the font, Indicate all the children with whoa you lnterect during s 
typical week. List children by initial* end ID #. Either lnltlele or ID # can bo uaad to 
complete the weekly echedule. Check to aaka euro that all inltlale are unique. That is, if 
two children hove the eeaa lnltlele, use e middle inltlel to dietinguleh one froa the other. 

B. ..Tine-elote heve been left blenk to eccoaoodete variance acroes prograa tiae echedules. Fill 

in the row labeled "Time 1 * eccording to the echedule ueed by the program. For exomplo, If 
children switch sctlvltiee every 20 minutee end school stsrts st 8t30, the time column would 
look like thie for Monday. 



DAY 



I MONDAY I TUESDAY 
I I 



Time 



8t30-8i50 I 8t30-9t00 



Room Exception! 1 



1 



Time 



I 8t30-9tl0 I 9t00-9t20 



Room Exceptions t 



Activity 



If 8t30 end 9*00 on Tuesday are devoted to large 
group activity i then uee e 30-*inute tine block 
(eee «o*ple)« Tiae block a do not heve to be the 
seme everydey. If time blocka are the aaiae each 
day, draw m arrow through the blocke to the right 
(eee eample). Not ell tine blocke will be ueed 
everydey md they do not have to egree acroea the 
top* 



C, Next, indicate on the apace lebalad "Room Number" (et the top of the form) the room in which 
moat of the ectlvltlea tike piece. Room numbers en be obtained from 1 FORM 1.81 1 • If there 
era exceptlone to the room given, liet the room ueed with each time block in the schedule. 

For example, on the semple form. Smith uaad Room 2.2 moat of the day. but 2.1 from 2i30-3t00 
and 3s 30-4,00 on Monday through Thuredey. Uee an arrow through blocke to the right to show 
that the room indiceted le an exception everydey. 

D. Finelly, piece the ectlvity In eech block of time. Activltiee should be indiceted according 
to the categories below. Use errows to ehow the eems activity taking plica ecroes aeverel 
days. 



i 
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DIRECT INTERVENTION 



Do not liat the worde " Direct Intervention* . .Instead, fill out the time echedulee using the 
ID number (or initiele) of each child who ie phyeicelly in the presence of the instructor for 
the time block ueedt If ell children who ere lifted et the top ere in the group for e 
perticuler time block, write the word "ell 9 * ineteed of lieting ID Is. If only one of the jJJ, 
group ie Hissing, writs "sll but lllll"/sss seaple). 

s. For intervention in the center— include the time spent with child for teeching or 
eupervieing. 

b. For intervention in the home— include any time spent in the hornet elone with child, with 
both perent end child, or elone with perent. Alweye eignify home intervention by thie 
notetion H . Without thie notetion, indicated time will be assumed ss center 
intervention. 

TRAVEL— Refere to trevel for home visits snd for center-releted ectivitiee that occur on e 
weekly basis end pertsin to perticuler children. Alweye ehow the child'o ID# in the epece 
labeled "Trevel", For example, include pereonnel time for eteff who drive e ven to treneport 
children between their homee and the center. Indicete the ID #e of thoee children who ride 
the ven during the indicated timee. Do not include trevel from home to work. Note thet 
trevel in conjunction with ectivitiee other than home visitstione 'end treneporting children 
should be included with thet ectivity. 

PREPARATION— re fere to ectivitiee thet support "Direct Intervention", for e*smpls, preperetion 
of meteriele, working up leeeon plene, orgenizing room, prepering food, deily recordkeeping, 
deily clean-up, end writing child epecific reports, Aleo included ere "eteff Inge" (meetings 
with aeverel stsff for the purpose of plenning curricu 1 for e epecific child). If soma kids 
require sore time then others (e.g., eevere require mv * xm then moderete), then prorete 
preperetion time eccording to an eetimeted rstio. * 



TEACHER AD (ADMINISTRATION )— rcfere to ectivitiee typicelly conducted by teachers, 
epecialiate, and other direct service providera. Theee ectivitiee ere uaually non- super vieory 
end coneiet mostly of generel etsff meetinge end routine peper work. Remember thet IEP or 
leeeon preperetion work ehould be coded under "Preperetion" end not "Adminietretive 
Activitiee". 



CENTER AD (ADMINISTRATION)- ref ere to ectivitiee ueuelly associated' with the dsy~to-day 
operstion of running s preschool center. Activitiee which ere supervieory (of direct eervice 
providere end other eteff) in type ehould be coded tnder thie heeding. 



Personnel Actione 
Supervieion of Direct Service 
Public Reletione 
Progrem & Stef f Eveluetione 
Generel Reporte 



Budget Management 
Advisory Boerd Meetings 
Purcheeing 
Steff Meetings 
Bookkeeping 
Directors' Meetinge 



Intersgency Activities 
Progrsm Plsnning 
Diseefltinotion 

Correepondence 4 Ccmmunicetion 
Report Writing 
Adminietretive Trevel 



REGIONAL AD (ADMINISTRATION)— refere to ectivitiee ueuelly eeeocietsd with ths day-to-day 
operation 'Of directing regionel preechool activitiee, Theee activitiee consist of aupervieing 
eupervieore and adminietretive pereonnel (bookkeepere, eecreteriee, etc.). The ectivitiee 
listed under 5 ebove (Center Administration) are aleo exomplee of ectivitiee to code under 
"Regionel Administration", Travel in conjunction with theaa ectivitiee should be added to 
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total tims. For sxaaple, if ■ board meting it held 60 miles aw*y from home, once a month for 
two houra, put 1 hour a week on schedule (2 houra travel + 2 hours meeting + 4 weeks s 1 
hour). 

9 

7. INSERVICE - refers to receiving md conducting ineervice training. For sample, if e teacher 
or en aide attends e aigning class once e week for en hour, this ectivity would be coded 
"Infervica". If a therepist trains cleasroom teechers by modeling intervention during claas, 
coda thie tins as ineervice for the thsrepiet. 

:* 8. ASSESSMENT (comprehensive eveluetion and acreening of children)~refers to weekly echeduled , 
aseeeement and teeting of children. Do not include deily aeeeeement of enrolled children thst 

is ussd to determine IEP progreaa (this ectivity would be part of inetruCtion end should be 

, coded under "Direct Intervention"). 

*• PARENT— re fere to regulerly echeduled parent treinlng and IEP meetings, excluding vieite in 
'conjunction with home program. Also include ehort unscheduled meetinge which occur frequently 
throughout the yesr. For thess, estimsts the time per week for e typicel week end record 
during the time slot ueuelly used. For inetencs, if ycu ueually talk to perente by phone ones 
or twics s week, estimsts the average time end list it on ths day (a) it ueuelly occure (eee 
example). 

10. C UST00 1 AL— refers to jenitorial work performed on any aection of tils facilities. Do not 
include daily atreightening up or orgenizetion jobs typically done by e teacher. Usuelly, 
thia_category will be uaed by the school cuatodian to indicate weekly activities. However, 
teechere who do their own custodial work (wash floors, clesi bsthrooms) should use this 
cstsgory. 

11. NON-PROGRAM— includes ectivitiee not funded by project, for inetencs, Dsy Cere time or Heed . 
Stert time. 

12. LUNCH— code this if stsff lunch is esten seperetely from childrsn or from meetings. If 
supervieing children during lunch, code as "Direct Intervention". If holding meetings during 
lunch, 'cods ss "sdministretion". 

V 
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DIRECTIONS FOR 
I FORM 1.22 I 
WEEKLY SCHEDULE - INDIRECT SERVICE 



To opacify tht typt of activitiee which staff are usually involvod with throughout tht ycer t 
•■eh direct esrvlcs pr ovider cpmol etes ■ weekly schedule. Place attff mm (or ID, #) it tht top 
of Mch page. Um ont t FORM Li22 I If your ochedule Is generally thi east ovary week. # If weekly 
actlvltlM vary elightly, Hat tht aetlvltlta uaually tngtgad in for a typical week. Da not 
include tctlvltltt Maooltttd with othtr pcojtcta (e.g., Haad Start)) indlcata oily inttrvtntlon 
conduct td for tht projtet being tnslyzsd. 



Coda I FORM 1,22 I In tht ordtr of cattgorltj si lltttd below. Follow tht dlrtctlont md 
daflnltlont in antarlng infomttlon. A temple I FORM 1,22 I has btan Includtd to llluttrttt how 
time can bt dlvldtd Into blocks* Follow tfy staps below* 

A, Time alota htvt bttn ltft blank to accossodatt varlanca tcroaa program tlsa achedulee. Fill 
... in tht row Itbtltd "Time" according to tht achtdult uttd by tht program. 

B* Next, indicata on tha apact labaltd "Room Number" (at tht top of tht form) tht room in which 
scat of tht tetivltlM takt pi tea. Room numbtra can ba obttintd from I FORM l.fll I . If there 
ara exceptione to tha room given, Hat tha room uatd with tach timt block in tht achadula. 
For oxempls, on tht ttmplt form, Smith uatd Room 2*2 moat of tha day, but 2.1 from 2i30-JtOQ 
and 3:30-4*00 on Monday through Thureday. Uat an trrow through blocks to tht right to ahow 
that tha room indicattd is an exception tvtrydty. 

C. Finally , plact tht activity in aach block of time. Activitiaa ahould bt indictttd according 
to tht categories btlow. Um errowe to ahow tha aaM activity taking plact acrOM aavtral 
dsyt. 



1. CENTER AD (ADMINISTRATION)* — rsfara to activitiaa usually taaociatad with tha day-to-day 
operation of running a prsachool csntar. Activitiaa which art tuptrvitory (of direct aarvioa 
providers and othtr ataff) in typt ahould ba coded tndar thia heading. 

Paraonnal Actlone Budget Management • Interagency Activitiee 

Supervlaion of Direct Service Adviaory Board Mtttingt Program Planning 

Public Reletlone Purcheting Dieeeminetion 

Program & Staff Evaluationa Staff Mtttinga Correepondence & Communication 

General Reports Bookkeeping Report Writing 

Dirtctore* Meetings Adminietretive Trevel 

2. REGIONAL AD (ADMINISTRATION)— reft re to activitiee uaually aeaodeted with the day-to-day 
operation of directing regional prttchool ectlvltlta. Than activities coneiet of suparviting 
eupervieort end tdminittrttivt ptrtonntl (bookktepurs, tecreteriee, etc.). Tht activities 
lietad under 5 tbovt (Ctnttr Adminlatretion) ere alao exemples of activitiaa to code under 
"Regional Adminietretion". Trevel in conjunction with theee ectivitiea ahould be added to 
total time. For example, if e board Meting ia held 60 miles awey from home, once a month for 
two houre, put 1 hour a wttk on ached u It (2 houre trevel * 2 houre matting ♦ 4 weeke a 1 
hour). 
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I FORM 1.211 
WEEKLY SCHEDULE - DIRECT SERVICE 



Initials ID* 



Sit* 



starr nmm 



Room Number 



DAY 


MONDAY 


TUESDAY 


WEDNESDAY 


vlii inf w 

THURSDAY 


FRIDAY 


OTHER 


TIME 














ROOM EXCEPTIONS 














ACTIVITY 














TIME 














ROOM EXCEPTIONS 














ACTIVITY 














TIME 














ROOM EXCEPTIONS 














ACTIVITY 














TIME 














ROOM EXCEPTIONS 














ACTIVITY 














TIME 














ROOM EXCEPTIONS 














ACTIVITY 














TIME 














tUOM EXCEPT IUN: 














ACTIVITY 














TIME 














ROOM EXCEPTIONS 














ACTIVITY 














TIME 














ROOM EXCEPTIONS 














ACTIVITY 














TIME 














ROOM EXCEPTIONS 














ACTIVITY 
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3. INSCBVICE - refero to receiving and conducting inoervico training. For wemple, if • teecher 
or an aide ettende ■ signing eltM onct ■ week. for en hour, this ectivity would be coded 
"Inaerviee". If e therepiet treine daeeroom teechers by modeling intervention during dee a, 
code thd'e tine as ineervice for the therepiet. 

4. ASSESSMENT (comprehensive evaluetion end ecreening of children)— refere to weekly echeduled 
eeeeeement end tooting of children. Do not include doily eeeeeement of enrolled children thet 
ie used to determine 1EP progreee (thie activity would be pert of inetruetion end ehould be 
coded .under "Direct Intervention"). 



• • •. .t-.-j ■ . . . 



^PARENT— refer* to ragulerly scheduled parent training and IEP msstings, excluding visits in 
• • conjunction with hoe* program. Alao include ohort unscheduled aeetinge which occur frequently 

throughout the yeer. For theeo, eotiaete the time per week for e typical weak and record 
• during the time elot usually used. For inotance, if you ueuelly talk to perenU by phone once 
or twice a week, estimate the average time and liet it on the day(e) it ueuelly occure (sss 
example). 

6. CUSTODIAL— refere to Jenitoriel work performed on eny eection of the fecilitiea. Do not 
Include daily etreightenir,j up or orgenizetion Jobs typicslly dons by s teacher. Ueuelly, 

— thie category will be uitod by the achool cuetodien to indicete weekly activitiea. However, 
.*' teechers who do their own custodial work (ween floore, clean bathrooms) should uss this 
cstegory. 

7. NOMOGRAM— Includes sctivitlss not funded by projsct, for instance, Dey Cere time or Head 
Start time. 

8. UWCH— code this if stsff lunch is sstsn sspsrstsly from childrer or from meetings. If 
eupervieing children during lunch, code ea "Direct Intervention". If holding meetinge during 
lunch, code aa "adminietretion". 
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I FORM 1.22 I 
WEEKLY SCHEDULE - INDIRECT SERVICE 



Sit* 



Staff N«M 
Room Number 



DAY 


MONDAY 


TUESDAY 


WEDNESDAY 


THURSDAY 


FRIDAY 


OTHER • 


TIME 














ROOM EXCEPTIONS 














ACTIVITY 














TIME 














ROOM EXCEPTIONS 














ACTIVITY 














TIME 














ROOM EXCEPTIONS 














ACTIVITY 














TIME 














ROOM EXCEPTIONS 














ACTIVITY 














TIME 














ROOM EXCEPTIONS 














ACTIVITY 














TIME 














ROOM EXCEPTIONS 














ACTIVITY 














TIME 














ROOM EXCEPTIONS 






• 








ACTIVITY 














TIME 














ROOM EXCEPTIONS 














ACTIVITY 






> 








TIME 














ROOM EXCEPTIONS 














ACTIVITY 















Copyright °1983 by Early Intervention Research Institute 



DIRECTIONS FOR 



1 FORM 1.23 I 
EXCEPTIONS TO WEEKLY SCHEDULE 



Moat activities conducted outaide of the weekly achedule are pre and post program activities 
with the enrolled children (e.g., testing, group activities), screening, or inservice. Since 
direct instruction is not tsking place on a daily basis, the weekly schedule does not define staff 
time allocation. Administrators, bookkeepers, and secretaries, however, who may not change their 
type of work, can deecribe their work using only the weekly schedule. Most direct intervenors 
will need to complete an exception form according to the following directions* 

A. List ths da tea that the weekly achedule begins and ends. 

B. List ths datss that employment with the program begins and ends. 

C. List all ths holidays during period of employment. 

D. List the approximate number of days in which various activities occur before and after the 
weekly schedule applies. Catsgorize activities by using ths following definitions. 

1. Preprogram activities - where staff supervise enrolled children who are not involved 
in direct service. Usually occurs at ths bsginning of the year when children 

participate in large group activities while others ars being tested. 

« 

2. Poetprooram activities - sams as "preprogram activities" except activities occur at 
the end of the progrem year, rather than the beginning. 

3. Screening - largs-scsle tssting dsaignsd to provids s quick svaluation of a number of 
children. Ususlly scheduled at ths beginning of or just prior to direct service. 

4. Assessment testing - includee lsrge-scale testing of enrolled children to establish s 
handicapping condition or annual progress, ususlly pre and post testing. 

5. Inservice training - Rafsrs to any training rscsived by any staff during contracted 
working time outside of direct service houre. Include travel to other locations (for 
inservice purposs) in ths tims spsnt on inssrvics. 
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I FORM 1.23 I 



EXCEPTIONS TO WEEKLY SCHEDULE 



Site 



Staff Name 



A. 



Inclusive dates for weekly schedules From 



Inclusive dates during which staff is employed} From 



List holidays occurring during entire period of employment* 



List activities which occur prior to and after weekly schedule is implemented* 



Dates 



Days 



1. Preprogram activities (with children) . 

2. Postprogram activities (with children) _____ 

3* Screening _ _ _ 

4* Assessment/testing _ — 

5* Inservice/t raining _ _ 

6* Other! , 

7. Other* ^ 



Others 




ERIC 



FORM 1.3 



Child Demographics 



The information requested will assist in analyzing the cost data 
at the individual child level and will provide a accurate description 
of the sample of children being served by the program. 
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I FORM 1.331 
CHILD DEMOGRAPHICS 



Complete I FORM 1.3d by following the directione below for eech column. 

A. CHILD ID! 

List all students who era enrolled in the clessroom by ID #. 

B. BIRTH DATE 

Give the month, day, and yeer when eech child wae born by ueing the reepective columne (e.g., 
llilOtSO). 

C. SEX 

Code the sex of each child as M a male and F s female. 

D. ROUND TRIP MILES 

Indicete the approximate number of round trio milee between center end home. 

E. HANDICAPPING CONDITION 

Code the primsry and secondery handicap of esch child. The primery handicep should be 
coneietent with the cetegory to which the child has been designstsd for funding purposes. The 
eecondery nendicsp msy not be recorded but cleerly impscts on the child' e ability to perform. 
Use the following ^bbrevietione for both primery end~secondary handicape. 



MR 
DF 
HH 
VI 
EMOT 



Mentally Retarded 
Deaf 

Hard of Hearing 
Visually Handicapped 
Emotionally Disturbed 



ORTHO 
OH I 
LO 

MULT I 

DB 

SI 



Orthopedic Handicap 
Other Health Impaired 
Specific Learning Disability 
Multiple Handicap 
Deaf /Blind 
Speech Impaired 



Fa CLASSIFIED HEALTH PROBLEMS 

List any special classifications as indicated below. 



No health problem 
Blind 

Hard of Hearing 
Deaf 

Cerebral Palsy 
Epilepsy 

Muscular Dystrophy 
Diabetes 

Asthma 

G. INITIAL DATE OF SERVICE 



Heart Impairment 
Hyperactivity 
Polio 
Arthritia 

Cleft Lip and/or Palate 
Chronic Sinus Infection 
Chronic Respiratory 
Spinal Bifida 
Obesity 



Tuberculosis 
Other neurological 
Tettninsl/degenerstive 
Hydrocephalic 
Microcephalic 
Multiple Sclerosis 
Cystic Fibrosis 
Chronic Strep Infection 
Other 

Down '8 Syndrome 



Indicate the date when each child started the home, center, and/or mixed program. For 
instance, a child who received home services for 2 years, then began a mixed program this 
year, would be coded 3 



H. CENTER SERVICE 



1 HOME 1 


CENTER 1 


MIXED J 


III 1 
1 S( 211 BO 1 


1 1 1 
1 1 1 


1 1 1 

4 a 82 1 



Indicate the typicel length of time eech center-baeed child spends at the center daily. Check 
either the "Full" dey, "1/2" dey, or "1 hr" column. For a child who sttends the center 
fecilltiee once or twice e week for spaolal servicee, check ths "I hr" box. |MT AAnu 4IJ1|I||I| t 



I FORM 1.301 



Site CHILD DEMOGRAPHICS Teacher 



A 

Child ID# 


B 

Birth 
Data 


C 

Sex 


D 

Rd Tp 
Miles 


E 

Handicapping 
Condition 


F 

Claaeified 
Health 
Probleme 


G 

Initial Date of Service 


H 

Center 
Service 


Home 


Center 


Mixed 


Primary 


Secondary 


Full 


1/2! 1 hr 
















• • 


i i 
























• • 


























- • 


• • 


























• • 
























• • 


• • 
























• • 


• • 


























• - 
























• • 


• • 


























• • 


























• • 
























• • 


• • 
























• • 


• • 
























• • 


• • 
























• • 


• • 


























• • 
























• • 


• • 


























































































































• 


























- — - 


- 
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FORMS 1.4 



Transportation of Children 



This section will provide the data needed to complete the yearly 
Individual child cost of transportation from home to the center for 
services. Included are provisions for transportation provided by program 
owned vehicles, leased vehicles, or parents (who are reimbursed). 
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Directions for 



I FORM 1,411 
Child Transportation Data 



This form will collate data on children transported to a center 
facility by a vehicle owned or Teased by the program or by parents. Each 
teacher should fill out one form. 

A. Child ID # 

B. RT miles . Indicate the round trip miles from home to center. 

C. Trips per year . Estimate the number of days the child will attend 
school during year and multiply times two. 

D. Type of service . Indicate what type of transportation is provided to 
the child using the following categories. If a child used more than one 
type of service, indicate all types and frequency of use. 

TC transportation company 
PR parent reimbursed 
PC parent contributed 

E. Vehicle number . Give an identification number of vehicle either owned , 
leased, or contracted that coincides with number given on | FORM 1.42 1 . 
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FORM 1.41 



Child Transportation Data 

• ____ 

Site Teacher 



A 

CHILD I0# 


0 

RT MILES 


c 

TRIPS 
PER YEAR 


D 

TYPE OF 
SERVICE 


E 

VEHICLE 
NUMBER 
























































- 
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Directions for 
FORn 1,42 | 



Vehicle Expenses 

This form will summarize all the information needed to compute a per 
child cost for bus or van service. One form should be completed for each 
vehicle. Use a school designated number or assign one for purposes of data 
collection. 

A. Vehicle type 

Provide all relevant descriptive data. 

B. Cost of vehicle 

Provide as many pieces of information that are available. 

C. Use of vehicle 

Explain any details to show the full extent of vehicle use durinq the 
fiscal year. 

D. Transportation company 

Describe the specifics of any transportation service that 1s contracted 
from a private business. Indicate cost per child per mile. 
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FORM 1.42 



VEHICLE EXPENSES 



A. Vehicle Type 



Make 



Model 



Vehicle Number 
Year 



Seating 
Capacity 



Air Cond 



Motor Size 



Insurance 

Maintenance 

Gas 



Date Purchased 

Purchase Price 

Estimated life 
span 



B. Cost of Vehicle 

Lease Cost 

Depredation Value 

Salvage Value 

Assessed Value 

C. Use of Vehicle During Year 

Total number of children riding per day _ 

Total number of preschool handicap children ridinq per day 

Average miles per day 

D. Transportation company (use this space If vehicle 1s contracted on a per child 
basis). Indicate how costs are derived and any schedules for service 
fluctuations. 
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FORM 1.43 



Directions for Parent Reimbursement 



Use this form to record any cost to program for parents who are 
reimbursed for transporting their child to and from the center for service. 
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I fORM 1.43 | 
Parent Reimbursement 



Site 



Parent Name 


REIMBURSEMENT 
DATE 


Chiid ID# 


VOUCHER # 




















































































• 






































• 




























• 
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DIRECTIONS FOR 



1 FORM 1.50 I 



EQUIPMENT 



The equipment form is used by each teacher (or intervenor) to determine the cost (or worth) 
of all major pieces of equipment used by the program. To be considered on this form, equipment 
must have a new or present value of $250 or more and a life expectancy of two years or more. 
Typical examples of equipment include: 



Typewriters 
Word processors 

Adaptive physical therapy devices 
Food preparation equipment 
Computers 
Copiers 

Playground equipment 
Directions for completing each column 



P.E. equipment 
Custodial equipment 
Audio-visual equipment 
Safety equipment 
Office furniture 
Major curriculum packages 



I FORM 1.50 • 1 are explained below. 



A. Equipment Name and Description 

List the brand name did description of each piece of equipment, e.g., Sylvania - color 
television - with remote control - 19 inch. 



B. Serial and/or Model # 

' List the identifying serial, model,' or manufacturing numbars. If possible, also list the date 
of manufacture. Model may also be a name. 

C. Frequency of Use 

Consider which child or children use or benefit directly from the equipment most frequently. 

Indicate with a check mark "✓" the level of most frequent use by a child or children (e.g., V 

daily; 3/wk s 3 or more times per week but less than daily; 1/wk s one or more times per week 

but less than 3/wk; 2/mos s 2 times per -nonth but less than 1/wk, etc.). 

D. Child ID fls 



List the ID Its of any child or children who use the equipment at the frequency which you just 
indicated in Column C. If all the children in your classroom or group U9e (or benefit from) 
the equipment approximately the same frsauency, wr£te "All" in Column D. For example, the 
illustration below shows a Sony (brand name) portable cassette recorder (descriptive name) 
being used 3/wk by all the children in the class. Next, a Jacuz2i heat bath is listed with a 
frequency of "daily" for children fls 123^, 5678, 9101, and 1121. The same Jacuzzi heat bath 
is also used with other children { 3141 ,* 5161, 7181) but at a lower frequency (1/wk). 
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I FORM 1.51 1 Teacher Namet 

CLASSROOM EQUIPMENT Site Namet 



EQUIPMENT NAME & DESCRIPTION 



B 

Serial #/or 
Model # 



FREQUENCY G~ USE 



Daily 3/Wk 



1/Wk 



2/Moa 



1/Mo 



6/Yr 



3/Yr 



1/Yr 



D 

CHILD 
ID ft 



i 
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FORM 1.52 



ADMINISTRATION EQUIPMENT 

Site Name: 



A 

EQUIPMENT NAME 

JL ftTCHD TOT TOW 


B 

• 

SERIAL # 
hp Mnnn i 




c 

USER 


nrr ire 

U r r 1 u u 


Site Names 


Sito Name: 


Site Namei 
























































































































































— — - — ■ 


















































♦ 
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A 

EQUIPMENT NAME 4 DESCRIPTION 


B 

Serial 0/or 
Model u 


C 

FREQUENCY OF USE 


D 

Child 

iU If 9 


Daily 


3/Wk 


1/Wk 


2/Moa 


1/Mo 


6/Yr 


3/Yr 


1/Yr 


Sony - Portable Cassette 
Tape Recorder 


Model s 
Super 124 

Serial 4 a 

123456 


















All 


Jacuzzi - Portable Heat Bath 
100 Gallon 


Models 
Deluxe 77 
Serial # s 
A69124 


















1234 
5678 
9101 
1121 


t! 




















3141 
5161 
7181 



Continue to list all the pieces of equipment used by your children, indicating the frequency of 
use by which children. 
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FORM 1.57 "1 



EQUIPMENT COST 

Site Name; 



A 

EQUIPMENT NAME 
a DtbuR IPT I UN 


B. 

SERIAL 4/OR 
MODEL r 


C 

OATE PURCHASED 

no Arnn Torn 
OR ACQUIRED 


0 

PURCHASE 
PR IC t 


: 

LEASE OR 1 

Dfki T At o ft Y e* 

RENTAL PR ICE 


































































-fc — 
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I FORM 1.61 1 
Home Service Schedule 



Site Staff Name 





MONDAY 


TUESDAY 


WEDNESDAY 


THUR5DAY 


FRIDAY 


WEEK 


END 




Child ID 


RT MiloB 


Child ID 


RT Miles 


Child ID 


RT Miles 


Child ID 


RT Miles 


Child ID 


RT Miles 


Child ID 


RT Miles 


■ 

WEEK 1 




















i 


• 




WEEK 2 














• 












WEEK 3 


























WEEK 4 
























* 
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1 FORM 1 
Staff Reimbursements 



Site' 



STAFF NAME 


REIMBURSEMENT 
DATE 


CHILD ID# OR 
PURPOSE OF TRIP 


II ffe 1 | mm I 1 *■ m% M 

VOUCHER I 








































































































































• 
















• 












* 












it 
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FORM 1,71 



COST OF TELEPHONE 

A. COST OF TELEPHONE SERVICE FOR PREVIOUS YEAR 

B. COST OF TELEPHONE SERVICE FROM JULY 1 TO.OATE 



I FORM 1.72" 1 
COST OF SUPPLIES 

A. TOTAL EXPENDITURE FOR PREVIOUS YEAR 

B. EXPENDITURES FROM JULY 1 TO DATE 
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DIRECTIONS FOR 



I FORM 1.81 I 



FLOOR PLAN 



The floor plan is used to ellocete portions of e facility to specific 
p ogram components. A pr o f aasi onal 1 y done floor plan may be used or a plan 
can be hend drawn. For e hand-drawn plan, uae en 8-1/2 X 11 inch peper and 
draw a rough plan of the building or buildinge in which the program operetee. 
Include only those rooma ueed entirely by the program or shared with another 
program. 00 NOT include fecilitiee ueed entirely by another program. A 
sample floor plan that illustrates the type of detail needed is attached. 
Indicate the following informetions 

A. ROOM LABELS 

Using s numbering system, lebel eech room with a unique number. The 
firet number of eech room ehould use the following codet 

1. edminietretive offices 6. food service 

2. classrooms 7. conference rooms 

3. specialists therspy rooms 8. multipurpose (gymnaaium, 



or example, three teecher officee could be labeled 90, 91, and 92. 
leven classrooms could be lebeled 201 through 211. 



B. DIMENSIONS 

Indicete the size of each room by giving the approximate numbsr of feet 
of the msjor walls. (See eemple floor plen.) Alao, ahow the overall 
dimensions of the totel building (the major outaide walls). 

The lsnd outside the facility which is used by the children (e.g., pley 
sreee) ehould be illuetrated and labeled! ehow the overall dimeneione of 
the outsids space, the dimeneione of eech eree of the outside epece, end 
lebel eech eree by use. The o utside area s may be illustrsted on the eeme 
floor plan with the facility ( 1 FORM 1.81 I ) or aeperately. A eeperete 
sample outside space illustration is included as sn example. 



(OT, PT, ST, testing) 



sudi torium) 
stsff offices 
other 



bathrooms 
storsge arees 



9. 
10. 




BEST COW /MUMBLE 




• 4 
* * 1 



1 •• 



1 1 1 1 1 i t 

mm 



So Good 6U:U 
FA<Mnry 



ft • • 



\ooo 
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DIRECTIONS FOR 



I FORM 1.B2 I 



ROOM 'SCHEDULE 



One I FORM 1 .82 I should be completed for •ech room used for direct 
intervention (direct intervention is defined ss "child is physicslly in ths 
presence of en instructor"). Ususlly, this will includs clsssrooms snd 
specislists* rooms. Multipurpose rooms used regulsrly by s psrticulsr group 
of children would slso bs included. Directions for completing I fORM 1.82 I 
ere listsd below: 

A. ROOM NUMBER AND DATES l 

Indicste the ssme room number ss givsn on the floor plsn. Givs ths dstss 
when the room echedule is in sffect. For exsmpls, if childrsn srs givsn 
dirsct intervention from September 12 to Msy 28, then thoss dstss would 
be indicstsd. If the room is used for s summer progrsm thst is different 
from the regulsr progrsm, two I FORM 1.82 I s should bs filled out for the 
seme room. 



8. STAFF NAME 

Liet each staff person who providee di'rect intervention to children in 
the room (side, teacher, specielist, edminietretor) . 



C. TIME WHEN ROOM IS IN U f i 

For each stsff, show ths time of dsy when the room is being ussd for 
direct intervention. If one stsff uses ths same room twice, but not 
consecutively, list the name twice) 



Note» If ell children use ill the direct, intervention spscs of e fscility 
all the t ime (e.g.. some progrsms opsrste in one lsrge open eras), do not 
complete I FORM 1.82 I ae directed above. Rether, mark I FORM 1.82 I with s 
large "X" end write s brief note explsining how the intervention space is 
used. Be sure to specify which areas of the facility are included. 



I STAFF NAME i 



MON 



I Kris Jonee 
I Kris Jonee 



8-10 
3-4 
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FORM 1«B2 



ROOM SCHEDULE 



A. ROOM NUMBER 



DATES WHEN SCHEDULE IS IN EFFECT t From 



To 



ERIC - 



B 


C. TIME WHEN ROOM IS IN USE 


STAFF NAME 


MONDAY 


TUESDAY 


WEDNESDAY 


THURSDAY 


FRIDAY 


SATURDAY 


SUNDAY 
















































































• 


















































































































































































































































































































































t 














1 
1 



















1 FORM '1.83 I 
COST OF FACILITY 

Site) 
Site Address; 



A. Check one. The fscility 1st | I rented or leased, I 1 owned by program, 

I 1 contributed, I I other 

(specify) 

B . If fscility is rsnted, leased, or contributed, indicate the cost of the 

fscility (sxcluding items in C below) for the past 12- mo nth periods $ 

If fscility is owned, give purchase price $ end dsts of purchase 



C. Indicate the cost of these items for the oast 12 months} insurance, 
utilities, taxes, or other items. 



ITEM 


Cost for Item for 
Previous 12 Months 


Indicate How Estimated 
Costs Were Oerived 


Utilities (epocify which 
utilities) 












Insurance (specify types 
of insurance) 












Taxes (specify which) 

• 












Other (specify) 


* 
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I FORM 1.91" I 

Site ID Number 

CONTRIBUTION SCHEDULE 
FAMILY SPECIFIC 



A 


B 

Estimated Houra/Month 


c 

Time 
Period 


D 

Equipment 
Serial 1 


E 

Materials/ 
Facilities 


F 

Money 


G 

Wwll'UBI 1 

sation 
Received 


io# or 


Instruction 


Secretarial/ 
Clerical 


neecinofl 


Other 
service 


Child 


Home 


School 


Froit 


T9 
































































































































































































































































• 
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A* Specify} Average houae size a 
Average I bed room a a 



FORM 

Home Space Costa /ConM',! H'^'D/J I 



Site 



aq ft 



B. Average rental a $ v 



/month, $ 



C. Average utilitiea a $ 



_/month f $ 



Jy ear 
/year 



D, Source(a) of information for A-C 



t. Utilitiea/year $_ 
a Coat/aq ft/hr $ 



+ Rent/year $ 



♦ Average # aq ft 



♦ 8760 hra 



F 


6 ■ '■' 


"TT" 

n 


P 1 I 

> X 


K 


Child 10 


1 Hours/Week Used 


Coat aq ft/hour 


I aq ft 

X 


I weeka of program 

X 


Program 


Parent 


Tot 


















a 


sf 












3 


a $ 












«a 














a 














a 


$ 












3 












a 




3$ 










a 




s S 
























«a 


a 






























3$ 












•a 














m 












t 

3 




3$ 




Tot Hrs 


Tot Hrs 


Tot Hra 






STotal Coat Home 




« Hrs 


* Hrs 


* : .a 






$ * Coat Home 



0 Copyright 1983 Csrly Intervention Research Institute. 
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I FORM 1.93 ' I 

Sits 10 Number 

CONTRIBUTION SCHEDULE 
GENERAL 



A 


B 

Instruction 


C 

Estimated Houre/M 


onth 


0 

Time 
Period 


r 

u 

equipment 
Serial I 


r 

r 

Mat* »r> i ale > 

Facilities 


p 
U 

Money 


u 

n 

Compen- 
aac ion 
Received 


ime or 
ID # 


Hours/ 
Month 


Specific 
Childrer 


Secretarial 
/Clerics! 


Meet* 
inqa 


ucner 


Service 


Froff 


To 




















1 


































































































































































































































1 
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4 



4-A.2 



Brief Description of the SKI*HI Model 



The SKI*HI Model contains three basic service components: Child 
Identification, home visit services, ancillary services. 

C hild Identification . Hearing Impaired children are Identified as close 
to birth as possible from high risk factors included on the Utah birth 
certificate. Audiologlcal testing 1s then done to confirm suspected hearing 
Impairment. Extensive public awareness campaigns and close referral 
cooperation with Utah medical and audiologlcal personnel also ensures early 
Identification. 

* 

Home visit services . Upon confirmation of the hearing loss, the child 1s 
fitted with amplification and the family receives weekly home visits from a 
parent advisor. This professional trains the family to provide maximal, 
effective auditory and language stimulation for the child 1n the home. This 
is done by first presenting the Home Hearing Aid Program . Parents are taught 
a series of lessons on such topics as how tne hearing aid operates, care of 
the aid, appropriate selection and fitting of the aid, and ensuring the 
child's full-time use of amplification. 

Parents also learn how to teach the child to use his amplified residual 
hearing. The Home Auditory Program enables parents to promote the listening 
capacity of the child, from awareness of loud environmental sounds to fine 
speech discriminations. Parents are taught a series of skill lessons in the 
Home Communication Program . They learn how to promote effective Interaction 
between themselves and the hearing Impaired child by establishing an effective 
home communication environment, establishing communicative contact with the 
child, and responding to the child's communication attempts by using effective 
verbal and non-verbal means. Parents are taught the Home Language Program 
which gives them the skills of consistent dialogue with the child in 
meaningful home situations, selection and Increased use of target vocabulary, 
and reinforcement and expansion of the child's linguistic output. If total 
communication 1s the appropriate language system for the child, the SKI*HI 
Model Includes a video-taped sign language program to teach families signs for 
use in the home. 

Ancillary services . All children receive regular audlological 
evaluations to monitor their hearing losses. A bank of loaner aids 1s 
available, so several can be tried on each child to determine the most 
appropriate amplification system. In case of hearing aid break -down, loaner 
aids can also be used as Immediate replacements. 

Psychological supportive services-are an important part of the SKI*HI 
Model. Parents of hearing impaired children attend parent group meetings 
where they receive information on topics of interest and share problems and 
gain new friendships with other parents of young hearing Impaired children. 
Direct counseling for parents' 1s available, and parent advisors consult with 
psychologists concerning immediate or potential psycho-sodal problems in the 
home. 

All children and parents are assessed regularly on a wide number of 
skills and are staffed at intervals to determine appropriate programmatic 
directions. '» '•' A ' 
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4-B. 



Teacher Rating: Compared to other students in class, how well does 

this child communicate? 0 «*poor 

5 ■ excellent 

0 12 3 4 5 (circle one) 



COMMUNICATION INVENTORY 
There are four sections to this inventory. 

(a) Section 1; how well the child responds verbally (or in sign) to 
your verbalized (or signed) Input. 

(b) Section 2: how well the child responds non-verbal ly to your 
verbalized (or signed) Input. 

(c) Section 3: how well the child responds verbally (or in sign) to 
your non-verbal input. 

(d) Section 4: how well the child responds non-verbal ly to your non- 
verbal input. 

There are 5 tasks in each area. All of the tasks are easily understood by 
hearing children 6+ years and older. If it is necessary to ask the question 
more than once, indicate how many times the question is re peated and circle 
that number by the question. Do not repeat the question more than 3 times. 

Section 1 (Write down the child's response) 

1. What is your name? 

2. How old are you? ] 

3. What grade are you in? 

4. Where do you live? , 

5. What is your teacher's name? , 

Section 2 (If child responds correctly, just write down o.k. If not, 
write down child's response) 

1. Please go to that chair (point to chair). , 



2. Please come back here. 



4-B.3 



3. Write your name in this square, 



4. Please give me that book (glance to book). 



5. Open it to page 



(indicate- page 1-20). 



Section 3 (Write down child's response) 



The man in these pictures is trying to let you know something. For 
example, here the man is letting you know that he is thinking or 
wondering about something (show trial plate I). Here the man is 
showing you "be quiet" (show trial plate II). What is the man letting 



showing you)? 


1. 


Plate 1: 


2. 


Plate 2: 


3. 


Plate 3: 


4. 


Plate 4: 


5. 


Plate 5: 



Section 4 (Ask the child to do what you show him/her to do. If child 
responds correctly, just write down o.k. If not, write down child's 
response) 

1. Motion "come here". Response: ' m 

2. Motion "stop". Response: 



3. Motion "turn around". Response: 



4. Motion for child to go over to chair about five feet away. 
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5. Ask the child to watch you and slowly count to 10. Before the child 
peaches 10, motion "sh, sh\ (be quiet). Response: 



Tell the child he can finish counting and reinforce child for. doing 
so. 



SCORE BOX 



A. ' 
Possible 
Points 



B. 

Total # 
Points Scored 



C. 

# of 

Repetitions 



D. 
Total 
Score 



# of Repetitions 
in C. which were on 
Items Scored M 0 M 



0 
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mpmmm , 

4-C.2 



Parent's Nima ■ 

PROJECT 5KI*H1 OUTREACH 
Parent Attitude Sole 



Reed iteh of thi statements below ind thin rata them as follows on the 
answer sheet on page 3, 

e 

SA mi md SO 

Stronqly Mildly Mildly Strongly 
Agrtt Agree D1 sagrtt Di sa grtt 

Indicate your opinion by blocking out thi enswtr which most closely 
rtfltcts your failing. (Umambtr 1f you strongly agree with tht statement 
block out SA, 1f you mildly agree block oui: ma, 1f you mildly dlsagrtt block 
out md* or.1f you strongly dlsagrtt block out SO. 

Thtre art no right or wrong answers, so answtr tach statement In tht way 
tMt rtfltcts how you feel. 



L 1 fttl a lot of ptople care about my child's development and an 
htlping ma. .. # . 

2. I am confused with all the information I get about communication 
methods (oral, total communication). 

3. 1 would prefer my child not wearing hearing aids 1n public so others 
would not know of his/her handicap. 

4. I trtat my hearing Impaired child essentially th; same as my other 
children. 

5. I am confustd about what other* say 1s or will be best for my child, 
e.g., where he/she should go to school, 1f special therapy 1s advis- 
able, what groups my child should join. y 

6. I don't know how to treat my child now that 1 know he/she 1s hearing 
Impaired. 

7. I am discouraged about the fact that my child 1s hearing Impaired.' 

8. Our child's hearing loss has been no serious problem to us. 

9. I think my child hears much better then most others think he/she does. 

10. I ft .id myself feeling ancry about the 1 situation of having a hearing 
impaired ch1l.d. 

11. I try my best each day and don't worry beyond that too much. 

12. To avoid enfcerressment at family and friend social occasions, (questions, 
stares, child 1 s behaviors), I stay home now more than before. 

13. In spite of bad days, 1 feel I can succeed with my hearing impaired 
child if I persist. 

It. 1 often feel guilty about whet I'm not doing to help my hearing impaired 
child. 

15. I do not understand very well what professionals like me to do in the 
home to help my child. i\ 

ERJC 16. ! am o'tei ^eressed^becausej^rea^v^r/t have the time er incline- 



I 

V • 
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17. I am desirous for my child to become a productive citizen. 

18. Because my child will need to function 1n a "hearing world", I would 
prefer hi/sho did nrc have any haarlng 1mpa1 red jfrl ends. 

19. I feel frustration and disappointment :ause my child can't understand 

20. I mi tmbtfTMstd when jtrtngtrs 1n public pltcts notlct my child 1s 
hairing 1mp*1rtd. 

21. I regret that 1t 1s basically my fault that my child 1s haarlng • 
handicapped. 

22. I got mors confused the more I hear about deafness. 

23. I often question 1f my child 1s receiving the best educational program 
or therapy. 

24. 1 find myself hoping my child's hearing will return even though I've 
been advised otherwise. 

25. I am angry with the doctor(s) who told me of my child's hearing problem 
because the diagnosis took too long or was misleading. 

25. When other people seem to be embarrassed with my hearing impaired child, 
that affects me in a negative way. 

27. I often worry about my child over being able to be on his/her own. 

28. I am looking forward to the raising of my hearing impaired child as a 
good, important experience. 

29. I get embarrassed when the hearing aid squeals at inopportune times. 

30. I removt the hearing aid from my child (or ask my child to remove the 
aid) when he/she plays rough for fear of damaging the aid. 

31. I feel confident as a parent with a handicapped child. 

32. It is very likely that God is punishing mi by giving me a child with a 
hearing loss. 

33. I am upset because it seems we are being, or were, forced Into a method 
of communication (oral, total communication) for my child. 

34. I take time for myself even though 1t is hard to come by. 

35. I find myself often feeling fearful for my hearing Impaired child's 
safety. 

35. Life would be much happier 1f I did not have to cope with the situation 
of having a hearing impaired child. 

37. I frequently get, angry about the problems of keeping a good hearing 
aid constantly on my child. 

38. 1 am discouraged because most professionals seem tt a loss to help 
much. 
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PROJECT SKI+HI PARENT ATTITUDE SCALE ANSWER SHE ET 

Name Address ' 

Child* s N&me 

Date ' 



1. 


SA 


ma 


md. 


SO 


22, 


SA 


ma 


md 

* • 


SD 


2. 


SA 


ma . 


md • 


SO 


23. 


SA 


'ma 


• md 


SD 


3. 


SA 


ma 


md 


SD 


24. 


SA 


ma 


md 


SD 


4. 


SA 


ma 


md 


SD 


• 25. 


SA 


ma 


md- 


SD 


5. 


SA 


ma 


md . 


.SD. 


26. 


SA 


ma 


md 


SD 


6. 


SA 


ma 


md 


SD 


27. 


SA 


ma 


md 


SD 


7. 


SA 


ma 


md 


SO 


28. 


SA 


'ma 


md 


SD 


8. 


SA 


ma 


md 


SD 


29. 


SA 


ma 


md 


SD 


9. 


SA' 


ma 


md. 


SD 


30. 


SA 


ma 


md 


SD 


10. 


SA 


ma 


. md 


SD 


31. 


SA 


ma 


md 


SD 


ii. 


SA 


ma 


md 


SD 


32. 


SA 


ma 


md 


SD 


12. 


SA 


ma 


md 


SD 


33. 


SA 


ma 


md 


SD 


13. 


SA 


ma 


md 


SD 


34. 


SA 


ma 


md 


SD 


14. 


SA 


ma 


md 


SD 


35. 


SA 


ma 


md 


SD 


15. 


SA 


ma 


md 


SD 


36. 


SA 


ma 


md 


SD 


1.6. 


SA 


ma 


md 


SD 


37. 


'SA 


ma 


md 


SD 


17. 


SA 


ma 


md 


SD / 


38. 


SA 


ma 


md 


SD 


18. 


SA 


ma 


md 


SD 












19. 


SA 


ma 


md 


SD 


* 










* 

20. 


SA 


ma 


md 


SD 


m 










21. 


SA 


ma 


md 


SD 
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Child's Name 
(to be filled in by USU) 

PARENT QUESTIONNAIRE 

Background Information 

1. School child 1s currently attendinq 



4-D.2 



(Town) 



(Name of School) 

1 (State) 



2. Child is in 



■oral classroom 

total communication classroom 

public school classroom (mainstreamed) 

other 



"3. Number of brothers and sisters in the home: 

4. Number of parents in the home: ____ 

5. Hearing status of parent (s): 



hearinq 

hearing impaired 

one parent hearing, one hearing impaired 



6, Occupation of father 

mother t 

7. Educational level of: 
(Check highest one completed) 

Less than high school 
High school graduate 
Colleqe graduate 
Masters • 
Doctorate 



8. Age of father 
mother 



Mother 



Father 



9. Did your child attend a preschool program? 
If yes, was the preschool: 



Yes 



No 



for hearing impaired - oral 

' for hearing impaired - total communication 

^ hearinq 

j other 

10. Does your child have handicaps other than the hearinq impairment? 
Yes No 



9 
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If yes, what type(s) of handicaps: 
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physical 

perceptual (vision) 
menial 
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. Questions About Hearing Imp aired Child 

1. During an average day, what percent of the. child's waking hours is the 
hearing aid worn? 

0 - 25X 

• • 26 - BOX 

51 - 75X 
76 - 100X 



2. Is your child receiving therapy in addition to school (therapy not part of 
regular school day)? Yei No 

If yes, which of the/following How many times Lenqth of 

types of therapy? each week? each session 

* 

speech • . 

academic (reading, 

writing, etc.) ' 

other 



3. During an average -day, how long does your child study or read (school books 
• or pleasure reading) outside of school? 

0-30 min. 

30 min. - 1 hr. * 

1 - 2 hrs. 

more than 2 hrs. . 



4. During an average day, what percent of your child's play is 

alone 

with friends • 

with brothers and sisters 



(should total lOOtf) 

♦ 

5. How many friends does your child *~.sociate with regularly? 



6. Would you consider your child's attitude tcvards school to be 

♦ 

better than most (ver, - .wlted about school) 

average (goes to schooi) 

worse than most (very unenthused about school- 
may resist) 

7. In your estimation, what percent of your child's communication is 
completely intelligible (understandable) by: 



ERJCBM !f 7 ^IttMS' 



Fami ly members Non-f ami ) y 



100% 


1 


7S - Mi 


1 


so - n u * 


| , — 


i 25 - W 454 I 
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8. Approximately how many middle ear infections has your child had during 
Ms/her life? 



0 - 3 yrs. 



4-7 yrs. 8 - 11 yrs. 



12-15 yrs. 



No. of 
infections: 
0 - 1 
* 2-3 
4 - 5 

6 or more ' 

9. During an average day, how much time do you spend communicating* with 
• ,your hearing impaired child? 

0 - 30 min. 
30 min. - 1 hr . 

1 - 2 hrs. 
more than 2 hrs.. 



10. Do you consider'your child's behavior to be 

' problem behavior (inappropriate for child's age) 

average for child's age 
• better than average (for child's age) 



V. 



9 
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DEVELOPMENT. OF NEW MEASURES 



Communication Inventory . A hearing impaired child's communication 
abilities (especially non-verbal) may not be accurately ascertained in 
formal language measures. Therefore, an inventory was developed to assess 
the child's ability to respond verbally and non-verbal ly to verbal and non- 
verbal messages required 1n daily living. The Communicative Abilities In 
Oaily Living Inventory (Holland, 1980) was used in the construction of the 
inventory. • 

The inventory was field tested on 15 hearing Impaired children ages 6 - 
13. Instruction clarification, content, and scoring revisions were made on 
the Inventory as a result of this field test. 

Then the Inventory was field tested on 16 hearing impaired children 
ages 6 - 13 at the Idaho Scool for the Oeaf. Teachers were also asked to 
rate the child's communicative abilities (when compared to other students 1n 
the classroom) on a scale from 0 - S (0 being poorest, 5 being the best). 

The scores on the communication Inventory were correlated with the 
teacher ratings and yielded a Pearson Product Moment Correlation coefficient 
of-<67. Feedback from the hearing Impaired children led to final 
Instructions content, and scoring revisions. 

Parent Questionnaire * A parent questionnaire was written which 
contained outcome variable items, such as percent time hearing aid worn, 
percent of family and non-family communication understood by child, percent 
child communication understood by family and non-family, ra';1ng of child 
behavior in home, and rating of child attitude toward school. 

In addition, factors that could possibly confound the treatment effects 
were obtained, such as educational level and occupation of parents, age of 
parents, number of siblings, and number of child middle ear infections. 

The first draft of the questionnaire was sent to 20 parents of hearing 
impaired children. They noted if questions were ambiguous and offered 
suggestions for clarification. The appropriateness of their responses to the 
questions also revealed question ambiguity. Final revisions were made 
accordingly. . 

Parent Attitude Scale . A first draft of the scale was given in 
interview form to 15 parents of hearing impaired children. Parents were 
asked if they had any questions understanding the items and if they would 
rather not be asked the questions. They were also asked to explain their 
responses to the questions (to determine if their answers were consistent 
with the questions and if not, why the questions were misunderstood). As a 
result of this phase of the field test, several wording revisions were made, 
and a few questions were deleted. 

Next, 6 professionals who work with the SKI*HI Model were asked to rate 
the relationship of SKI*HI intervention impact to the atti tudinal items. As 
a result of this, a few items somewhat remotely related to intervention were 
also dropped. 
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Rational sub-categories were then selected for the remaining items so 
sub-scores could be obtained. The categories were: 



(a) reactions to outside help, 

(b.) anxiety/guilt, and 

(c) acceptance of the hearing impairment. ' 

The parent attitude scale was then sent to parents of children in this 
study. After the scales were returned, a factor analysis was performed to 
see 1f more appropriate sub-categories could be obtained' for scortng. The 
factor analysis yielded 13 factors. Parent attitude items that were loaded 
highly and predominantly on one factor were then grouped by factor. 

Only one factor had more than three items. Only three or four of the 
thirteen factors couid be appropriately labeled to subsume all Items. 

Since the factor analysis did not yield successful sub-categories, an 
analysis was done on the rational sub-categories. Each item within a 
logical sub-category was correlated with the other items 1n that category. 
Six items had low sub-category correlation coefficients (< .2) and were 
subsequently deleted from the scale. The remaining 32 Items in the three 
rational sub-categories were then used for this study. 
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Thursday, March 17 
9:00 - 9:45 



9:45 
10:30 
10:45 
11:15 - 

12:00 - 
1:00 - 
1:30 - 



10:30 
10:45 
11:15 
12:00 

1:00 
1:30 
4:30 



Friday, March 18 
9:00 - 10:30 
10:30 - 10:45 
10:45 - 11:45 
11:45 - 1:00 
1:00 - 2:30 
2:30 - 4:30 
Tuesday, March 22 
•8:30 - 12:00 



12:00 - 
1:00 - 
2:0C - 



1:00 
2:00 
4:00 



4:00 - 5:00 



TRAINING AGENDA " 4 . F<2 



Introduction 
Explanation of EIRI 
Explanation of Longitudinal Study 
(Or. Karl White and Sue Watkins) 

Communication Inventory (Sue Watkins) 
Break 

Communication Inventory Practicum 

Kendall -Meadow Social Emotional Inventory • * 
(Sue Watkins, Program Administrator, Department 
of Communicative Disorders) 

Lunch 

Kendall -Meadow Continue 

Woodcock-Johnson (Dennis Clarkston, Doctoral Student, 
Special Education Department) 



Peabody Picture Vocab. (explanation) (Sue Watkins) 
Break 

Peabody Practicum 
Lunch 

Gardner Test and Practicum (Sue Watkins) 
Travel/Schedules 



Carrow Test for Auditory Comprehension of Language and 
Developmental Sentence Scoring (Carol Strong, Assistant 
Professor, Department; of Communicative Disorders) 

Lunch 

Arizona Articulation Proficiency Test (Carol Strong) 

Filming Arizona and Language Samples (Bob Lake, Director 
of Media, Exceptional Child Center) 

Finalize schedules - Travel arrangements (Sue Watkins) 
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